-- Logs begin at Fri 2022-08-26 14:52:39 UTC, end at Fri 2022-08-26 15:56:54 UTC. -- Aug 26 15:25:27.010998 dv-cinder-851449-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 15:25:27.021821 dv-cinder-851449-7-smb devstack@keystone.service[81809]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 15:25:27 2022] *** Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: nodename: dv-cinder-851449-7-smb Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: machine: x86_64 Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: clock source: unix Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: pcre jit disabled Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: detected number of CPU cores: 4 Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: current working directory: / Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: detected binary path: /usr/bin/uwsgi-core Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: your processes number limit is 47680 Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: your memory page size is 4096 bytes Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: detected max file descriptor number: 2048 Aug 26 15:25:27.022397 dv-cinder-851449-7-smb devstack@keystone.service[81809]: lock engine: pthread robust mutexes Aug 26 15:25:27.023062 dv-cinder-851449-7-smb devstack@keystone.service[81809]: thunder lock: enabled Aug 26 15:25:27.023062 dv-cinder-851449-7-smb devstack@keystone.service[81809]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 15:25:27.023062 dv-cinder-851449-7-smb devstack@keystone.service[81809]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 15:25:27.065631 dv-cinder-851449-7-smb devstack@keystone.service[81809]: Python main interpreter initialized at 0x55f9ac4b99c0 Aug 26 15:25:27.065631 dv-cinder-851449-7-smb devstack@keystone.service[81809]: python threads support enabled Aug 26 15:25:27.065631 dv-cinder-851449-7-smb devstack@keystone.service[81809]: your server socket listen backlog is limited to 100 connections Aug 26 15:25:27.065631 dv-cinder-851449-7-smb devstack@keystone.service[81809]: your mercy for graceful operations on workers is 90 seconds Aug 26 15:25:27.066069 dv-cinder-851449-7-smb devstack@keystone.service[81809]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 15:25:27.066069 dv-cinder-851449-7-smb devstack@keystone.service[81809]: *** Operational MODE: preforking *** Aug 26 15:25:27.066359 dv-cinder-851449-7-smb devstack@keystone.service[81809]: *** uWSGI is running in multiple interpreter mode *** Aug 26 15:25:27.066359 dv-cinder-851449-7-smb devstack@keystone.service[81809]: spawned uWSGI master process (pid: 81809) Aug 26 15:25:27.066566 dv-cinder-851449-7-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 26 15:25:27.069392 dv-cinder-851449-7-smb devstack@keystone.service[81809]: spawned uWSGI worker 1 (pid: 81827, cores: 1) Aug 26 15:25:27.069715 dv-cinder-851449-7-smb devstack@keystone.service[81809]: spawned uWSGI worker 2 (pid: 81828, cores: 1) Aug 26 15:25:27.071824 dv-cinder-851449-7-smb devstack@keystone.service[81809]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 15:25:31.420096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:25:31.420096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: from cryptography.utils import int_from_bytes Aug 26 15:25:31.420940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:25:31.420940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: from cryptography.utils import int_from_bytes Aug 26 15:25:31.428627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:25:31.428627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: from cryptography.utils import int_from_bytes Aug 26 15:25:31.429080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:25:31.429080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: from cryptography.utils import int_from_bytes Aug 26 15:25:31.470898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:25:31.471069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:25:31.471265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] command line args: [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:25:31.471534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:25:31.471713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ================================================================================ {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:25:31.471967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] admin_token = **** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.472213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] config_dir = [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.472401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.472585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] config_source = [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.472767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] debug = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.472967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.473335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.473516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.473768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.474041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.474276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] list_limit = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.474456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] log_config_append = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.474635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.474814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] log_dir = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.474997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] log_file = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.475224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.475468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.475715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.475962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.476138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.476315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.476558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.476803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.477035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.477267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.477500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.477738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.477829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:25:31.478012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.478101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:25:31.478237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] command line args: [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:25:31.478320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.478511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:25:31.478588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.478693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ================================================================================ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:25:31.478950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] admin_token = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] publish_errors = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] config_dir = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] config_source = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] debug = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.479941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] standard_threads = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.480936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] log_config_append = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] use_journal = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481409 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] use_json = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] log_dir = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] use_stderr = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] log_file = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.481829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] use_syslog = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.482010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.482087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.482319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.482429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.482550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.482616 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.482815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.482900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.482983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.483124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.483208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.483379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.483466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.483621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.483705 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.483854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.483930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.484091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.484177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.484328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.484406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.484563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.484641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.484809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.484942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.485024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.485096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.485276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.485365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.485514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.485761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.485858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.485999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] publish_errors = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.486345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.486502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.486582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.486738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.486815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.486919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.487004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.487168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.487247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.487404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.487489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.487640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] standard_threads = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.487716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.487877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.487956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.488122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.488206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.488284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.488424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.488513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] use_journal = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.488629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] use_json = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.488706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.488804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] use_stderr = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.488887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.488985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] use_syslog = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.489080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.489217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:31.489317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.489475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.489552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.489717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.489804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.490971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.491048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.491210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.491295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.491443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.491521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.491681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.491758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.491916 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492840 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.492919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.493077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.493154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.493320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.493401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.493548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.493625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.493786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.493883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494845 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.494998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.495074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.495236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.495313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.495473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.495553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.495705 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.495781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.495940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496160 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496395 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.496952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.497109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.497188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.497339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.497424 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.497599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.497677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.498382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.498473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.498647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.498730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.498885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.498999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.499123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.499274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.499372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.499549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.499635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.499793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.499871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.500977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.501097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.501217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.501301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.501448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.501527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.501686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.501775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.501946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502438 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.502968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.503120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.503238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.503356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.503436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.503589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.503667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.503821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.503907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.504072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.504153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.504311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.504431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.504552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.504637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.504783 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.504863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.505988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.506069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.506221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.506302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.506454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.506539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.506691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.506770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.506924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.507966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.508125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.508202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.508395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.508476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.508600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.508687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.508836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] auth.external = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.508923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.509070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.509159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.509308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.509386 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.509547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.509627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.509785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.509895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] auth.password = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.510049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.510128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] auth.token = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.510289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.510367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.510528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.510616 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.510774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.510853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.511957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] credential.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.512988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.513132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.513211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.513367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.513445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.514159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.514343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.514425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.514623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.514717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.514862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.514943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.515100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.515181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.515360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.515439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.515623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.515710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.515869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.515951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.516104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.external = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.516184 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.516340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.516419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.516583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] federation.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.516671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.516823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.516909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.517069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.517149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.password = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.517304 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.token = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.517383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.517535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.517619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.517781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.517879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.518056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.518138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.518292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.518372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.518542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.518622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.518792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.518872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.519027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.519108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.519269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.519350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.519505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.519585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.519754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.519844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.520948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.521027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.521187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.521267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.521435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.521523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.521688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.521767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.521944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.522025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.522179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.522271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.522413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.522493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.522658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.522738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.522907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523396 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.523992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.524141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.524221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.524380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.524468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.524700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.528849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.529029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.529161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.529246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.529424 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.529595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.529766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.529947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.530890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531042 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531172 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.531965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532263 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.532942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.533918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.534935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.535963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.536990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.537117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.537199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.537371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.537458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.537614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.537694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.537865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.537950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.538125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.538204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.538375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.538453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.538605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.538686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.538844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.538922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.539079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.539157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.539310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.539390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.539545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.539666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.539793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.539919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.540035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.540161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.540266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.540416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.540496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.540669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.540758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] resource.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.540923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541488 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.541990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.542146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.542237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.542379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.542459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.542618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.542696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.542858 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.542947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.543096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] role.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.543175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.543342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.543420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] role.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.543571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.543658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.543815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.543894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.544059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.544137 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.544299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.544389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.544541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.544621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.545363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.545481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.545623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.545725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.545896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.545980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.546192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.546283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.546432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.546515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.546690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.546769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.546925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.547005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.547176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.547267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.547419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.547499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.547663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.547867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.547955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.548108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.548188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.548360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.548440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.548597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.548683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.548837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.548917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.549084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.549165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.549318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.549425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.549576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.549829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.550092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.550327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.550559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.550792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.551043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.551301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.551547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.551784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.551871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.552024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.552256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.552493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] token.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.552732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.552983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.553226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.553480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.553729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.553995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.554244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.554429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.554510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.554724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.554813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.554959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.555038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.555198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.555277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.555434 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.555516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.555681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.555760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.555958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.556037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.556189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.556279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] role.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.556433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.556515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] role.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.556699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.556780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.556961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.connection = **** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.557049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.557207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.557287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.557456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.557536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.557696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.557784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.557963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558045 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.558998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.559162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.559252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.559400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.559488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.559644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.559724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.559880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.559968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.560127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.560291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.560480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.561127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.561389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.561553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.561653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.561801 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.561968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.562074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.562179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.562318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.562423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.562505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:25:31.562686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.562946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.563195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.563474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.563715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.563955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.564213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.564473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.564725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.564969 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.565212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.565448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.565689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] token.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.565953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.566224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.566651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.567142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.567613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.569080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.569080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.569080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.569080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.569080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.569429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.569549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.569804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.570118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.570357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.570895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.570895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.571359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.571844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.572300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.572773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.573252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.574846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.574846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.574846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.574846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.574846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.575193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.575409 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.575717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.576014 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.576265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.576523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.576765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.577014 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.577258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.577435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:25:31.596175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.596406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.596635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.606831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.607116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.607888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.608196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.616962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.637594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.637826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.638679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.638866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.692183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.692570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.741301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.741533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.741818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.742080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.899471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.899704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.899937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.900121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.900235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.900360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.900446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.900578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.900661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.900797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.901015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.901233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.925137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.925327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.925441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.925566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.925676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.925776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.925902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.926008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.926122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.926233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.926340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.926444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.926625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.926748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.938219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.938612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.951389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.951506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.951573 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.951651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.951854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.951939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.952071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.952155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.952285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.952368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.952498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.952580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.952741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.952962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.969964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.970176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 15:25:31.970425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.970510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.970643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 15:25:31.970742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 15:25:31.970975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.971056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.971185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 15:25:31.971267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.971466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.971736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.971816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.971997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.972077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.972258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.981340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.981621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.981888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.981974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.982186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.982910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.983000 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.983263 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.990135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.990527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.993037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.993324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.993431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.993610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.993720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.993919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.994071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.994210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.994313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.994482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.994602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.994754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.994870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.995028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.995145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.995411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.995501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.995691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.995773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.995963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.996044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.996233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.018670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.019148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.020133 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.020419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.020619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.020905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.025105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.025393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.025613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.025696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.025929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.026219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.032605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.032892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.033204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.033490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.037004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.037298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.037586 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.037668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.037893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.037991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.038176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.038259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.038453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.038534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.038728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.038809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.038996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.039076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.039269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.039539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.056698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.056980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.057390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.057673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.060952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.061793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.064269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.064571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.065130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.065432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.068800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.069650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.071956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.072824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.075220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.075529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.075817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.076115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.076231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.076518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.076645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.076822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.076905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.077135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.077432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.077724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.093479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.093764 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.094069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.094348 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.094429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.094693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.094975 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.095241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.101226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.102154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.102790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.103070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.103682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.103961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.105702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.106019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.106328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.106617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.106698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.106899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.106981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.107756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.108056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.108337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.119232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.119521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.119805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.120276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.120361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.120433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.120517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.120594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.120676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.120838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.120921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.121124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.121405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.121688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.136644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.137265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.139776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.140743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.142686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.143676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.144124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.145119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.145600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.145905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.146212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.146631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.146928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.147215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.152689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.153689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.154718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.155815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.157614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.157935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.158223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.158500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.158748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.159044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.159342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.159627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.166438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.166738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.167020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.167613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.167913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.168202 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.174720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.175004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.175286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.175567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.175830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:32.175921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.176112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.176197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.176388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.176470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.176680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.176771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.176929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.177019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.177203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.177298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.177481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.177564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.177745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.177829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.178045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.178141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.178308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.178392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.178593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.178858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.179139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.179403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:32.212943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f9ac4b99c0 pid: 81828 (default app) Aug 26 15:25:32.213509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f9ac4b99c0 pid: 81827 (default app) Aug 26 15:25:32.216339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03561d-334a-4c7e-9cb1-5c26a162f0f7 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:32.217181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03561d-334a-4c7e-9cb1-5c26a162f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:32.217457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03561d-334a-4c7e-9cb1-5c26a162f0f7 None None] PATH_INFO: `/v3` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:32.221546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Fri Aug 26 15:25:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:38.841862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca95fb-5da7-44dd-82b4-1047a4cc8d45 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:38.842395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca95fb-5da7-44dd-82b4-1047a4cc8d45 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:38.842479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca95fb-5da7-44dd-82b4-1047a4cc8d45 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:38.846806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:25:38.852275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:38.852688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:38.852824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:38.924034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: INFO dbcounter [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] Registered counter for database keystone Aug 26 15:25:38.944040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG oslo_db.sqlalchemy.engines [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:25:38.950132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writer thread running {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:25:39.128593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG passlib.handlers.bcrypt [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81828) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 15:25:39.129032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG passlib.handlers.bcrypt [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81828) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 15:25:39.187386 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:39.188957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:39.317096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 26 15:25:39.801940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca95fb-5da7-44dd-82b4-1047a4cc8d45 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:39.876227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: INFO dbcounter [None req-80ca95fb-5da7-44dd-82b4-1047a4cc8d45 None None] Registered counter for database keystone Aug 26 15:25:39.906072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG oslo_db.sqlalchemy.engines [None req-80ca95fb-5da7-44dd-82b4-1047a4cc8d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:25:39.912248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writer thread running {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:25:40.030652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca95fb-5da7-44dd-82b4-1047a4cc8d45 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:40.034922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddac4a-c971-47b7-a275-05de093ebe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:40.035551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddac4a-c971-47b7-a275-05de093ebe79 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:40.035836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddac4a-c971-47b7-a275-05de093ebe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:40.036112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddac4a-c971-47b7-a275-05de093ebe79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:40.044167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddac4a-c971-47b7-a275-05de093ebe79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:40.096265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a9ddac4a-c971-47b7-a275-05de093ebe79 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 15:25:40.096605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddac4a-c971-47b7-a275-05de093ebe79 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:40.106152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Aug 26 15:25:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:25:40.112451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:40.126833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff200c6-6d04-4c61-81dd-2ba2e848e1b4 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:40.131787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cba893-39cb-41e3-90e5-0f3cc9414b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:40.132921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba893-39cb-41e3-90e5-0f3cc9414b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:40.133210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba893-39cb-41e3-90e5-0f3cc9414b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:40.133487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba893-39cb-41e3-90e5-0f3cc9414b65 admin admin] PATH_INFO: `/v3/projects/e63b0c3551a8436a97c9341435afc499` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:40.135092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cba893-39cb-41e3-90e5-0f3cc9414b65 admin admin] RBAC: Authorizing `identity:get_project(project_id=e63b0c3551a8436a97c9341435afc499)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:40.189631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING keystone.common.rbac_enforcer.enforcer [None req-48cba893-39cb-41e3-90e5-0f3cc9414b65 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 15:25:40.190005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cba893-39cb-41e3-90e5-0f3cc9414b65 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:40.194547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Fri Aug 26 15:25:40 2022] GET /identity/v3/projects/e63b0c3551a8436a97c9341435afc499 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:42.105243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27e10-56fa-4014-9594-54e4b89629ed None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:42.105785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27e10-56fa-4014-9594-54e4b89629ed None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:42.105785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27e10-56fa-4014-9594-54e4b89629ed None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:42.109881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:42.115681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3396-32a2-43f0-9f96-033c85d955af None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:42.116178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3396-32a2-43f0-9f96-033c85d955af None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:42.116274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3396-32a2-43f0-9f96-033c85d955af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:42.136578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-875a3396-32a2-43f0-9f96-033c85d955af None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:42.138659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-875a3396-32a2-43f0-9f96-033c85d955af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:42.146481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 15:25:42.414907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed27e10-56fa-4014-9594-54e4b89629ed None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:42.427030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed27e10-56fa-4014-9594-54e4b89629ed None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:42.431148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bfaee-023b-484a-97ba-562c33c5b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:42.431745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bfaee-023b-484a-97ba-562c33c5b5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:42.432025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bfaee-023b-484a-97ba-562c33c5b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:42.432299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bfaee-023b-484a-97ba-562c33c5b5ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:42.440514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bfaee-023b-484a-97ba-562c33c5b5ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:42.442343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bfaee-023b-484a-97ba-562c33c5b5ca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:42.451761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Aug 26 15:25:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:25:42.457535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a3396-32a2-43f0-9f96-033c85d955af None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:42.466946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a3396-32a2-43f0-9f96-033c85d955af None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:42.471402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5141a-357a-4dae-b42e-c71dcafd6269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:42.472036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5141a-357a-4dae-b42e-c71dcafd6269 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:42.472322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5141a-357a-4dae-b42e-c71dcafd6269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:42.472601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5141a-357a-4dae-b42e-c71dcafd6269 admin admin] PATH_INFO: `/v3/users/12ecd30dbfea46b7b32ac0a7df499823` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:42.473957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5141a-357a-4dae-b42e-c71dcafd6269 admin admin] RBAC: Authorizing `identity:get_user(user_id=12ecd30dbfea46b7b32ac0a7df499823)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:42.475804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5141a-357a-4dae-b42e-c71dcafd6269 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:42.477333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Fri Aug 26 15:25:42 2022] GET /identity/v3/users/12ecd30dbfea46b7b32ac0a7df499823 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:44.457104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56dd8-c7dd-4f8a-9327-cf899cfc6018 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.457606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56dd8-c7dd-4f8a-9327-cf899cfc6018 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.457606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c56dd8-c7dd-4f8a-9327-cf899cfc6018 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.458932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:44.464187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04fc97-d93d-4b3f-b42e-f269a3faa391 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.464585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04fc97-d93d-4b3f-b42e-f269a3faa391 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.464825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04fc97-d93d-4b3f-b42e-f269a3faa391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.483321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ad04fc97-d93d-4b3f-b42e-f269a3faa391 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:44.484508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ad04fc97-d93d-4b3f-b42e-f269a3faa391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:44.490638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78b89-34b8-41bc-8518-5eb7bff88bb0 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.490927 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78b89-34b8-41bc-8518-5eb7bff88bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.491205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78b89-34b8-41bc-8518-5eb7bff88bb0 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.492520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:44.497278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.498268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.498679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.539657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG passlib.handlers.bcrypt [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81827) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 15:25:44.540087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG passlib.handlers.bcrypt [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81827) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 15:25:44.565239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:44.586141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:44.587735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:44.685039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:25:44.833719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04fc97-d93d-4b3f-b42e-f269a3faa391 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.858664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:44.940804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04fc97-d93d-4b3f-b42e-f269a3faa391 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.955208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.974719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7168-7e02-49b3-ba88-e2d757d4b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.975366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7168-7e02-49b3-ba88-e2d757d4b67b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.975651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7168-7e02-49b3-ba88-e2d757d4b67b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.975931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7168-7e02-49b3-ba88-e2d757d4b67b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.987878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f7168-7e02-49b3-ba88-e2d757d4b67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-150f7168-7e02-49b3-ba88-e2d757d4b67b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:44.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:44.998291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:25:44.999152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:25:45.004197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7168-7e02-49b3-ba88-e2d757d4b67b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:45.064476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a027e1f-6b1c-4e1e-8335-75bc02561ac6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:45.066882 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:45.102978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:45.108130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cea77e-77b6-4e14-9062-7ce55903c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:45.109108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea77e-77b6-4e14-9062-7ce55903c19e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:45.109388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea77e-77b6-4e14-9062-7ce55903c19e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:45.109673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea77e-77b6-4e14-9062-7ce55903c19e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:45.123154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7168-7e02-49b3-ba88-e2d757d4b67b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:45.160713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:45.161322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:45.161598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:45.161903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:45.162571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:45.162876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:45.164267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:45.176433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:45.182130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:45.184154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cea77e-77b6-4e14-9062-7ce55903c19e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:45.186347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cea77e-77b6-4e14-9062-7ce55903c19e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:45.282413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba7e05-0c97-401f-83e2-e031f36eb5b1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:45.284282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:25:45.290116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cea77e-77b6-4e14-9062-7ce55903c19e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:45.292807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:45.316918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d8246-6d57-4859-a2a2-c50b4f103c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:45.317554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d8246-6d57-4859-a2a2-c50b4f103c3e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:45.317859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d8246-6d57-4859-a2a2-c50b4f103c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:45.318139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d8246-6d57-4859-a2a2-c50b4f103c3e None admin] PATH_INFO: `/v3/users/12ecd30dbfea46b7b32ac0a7df499823` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:45.319275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d8246-6d57-4859-a2a2-c50b4f103c3e None admin] RBAC: Authorizing `identity:get_user(user_id=12ecd30dbfea46b7b32ac0a7df499823)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:45.320750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d8246-6d57-4859-a2a2-c50b4f103c3e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:45.322360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:45 2022] GET /identity/v3/users/12ecd30dbfea46b7b32ac0a7df499823 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:45.328669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d8246-6d57-4859-a2a2-c50b4f103c3e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:45.343762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:45.393129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cea77e-77b6-4e14-9062-7ce55903c19e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:45.427272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:45.428122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:45.428410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:45.428689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:45.428775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d8246-6d57-4859-a2a2-c50b4f103c3e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:45.447390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:45.448869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:45.462440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d67b6-e3de-4ccf-8f34-00fcfc1f88e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:45.463070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d67b6-e3de-4ccf-8f34-00fcfc1f88e7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:45.463353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d67b6-e3de-4ccf-8f34-00fcfc1f88e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:45.463626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d67b6-e3de-4ccf-8f34-00fcfc1f88e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:45.464724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d67b6-e3de-4ccf-8f34-00fcfc1f88e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:45.466408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d67b6-e3de-4ccf-8f34-00fcfc1f88e7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:25:45.467584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:45.468854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:25:45.469656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:25:45.469656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:25:45.469656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:25:45.469656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:25:45.470238 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:45.473862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:45.474861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d67b6-e3de-4ccf-8f34-00fcfc1f88e7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:45.530470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:45.558650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:45.574997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec91bd6-c0b0-4fdb-a72f-520722f08843 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:45.580051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d67b6-e3de-4ccf-8f34-00fcfc1f88e7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:45.609093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e8f53-b4ca-47eb-b142-2ccf4011a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:45.609707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e8f53-b4ca-47eb-b142-2ccf4011a37a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:45.610023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e8f53-b4ca-47eb-b142-2ccf4011a37a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:45.610302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e8f53-b4ca-47eb-b142-2ccf4011a37a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:45.611025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e8f53-b4ca-47eb-b142-2ccf4011a37a None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.domain.id=default, user.id=12ecd30dbfea46b7b32ac0a7df499823) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:45.611597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e8f53-b4ca-47eb-b142-2ccf4011a37a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:45.613053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e8f53-b4ca-47eb-b142-2ccf4011a37a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:45.613278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55970cfd-7c4e-486e-bc3c-fd4b56678132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:45.613918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55970cfd-7c4e-486e-bc3c-fd4b56678132 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:45.614207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55970cfd-7c4e-486e-bc3c-fd4b56678132 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:45.614485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55970cfd-7c4e-486e-bc3c-fd4b56678132 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:45.615132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55970cfd-7c4e-486e-bc3c-fd4b56678132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:45.615439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55970cfd-7c4e-486e-bc3c-fd4b56678132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:45.616807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55970cfd-7c4e-486e-bc3c-fd4b56678132 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:45.623571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Aug 26 15:25:45 2022] GET /identity/v3/role_assignments?user.id=12ecd30dbfea46b7b32ac0a7df499823&scope.domain.id=default&role.id=cac8d7ae8325488684667d62304b0860 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:45.638727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:47.776452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d72be-0076-422c-8367-59a78f51e80c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.776988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d72be-0076-422c-8367-59a78f51e80c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.776988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d72be-0076-422c-8367-59a78f51e80c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.779379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:47.796249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff0de-bd3a-410a-90b4-71bb6d3d57d0 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.796745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff0de-bd3a-410a-90b4-71bb6d3d57d0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.796840 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff0de-bd3a-410a-90b4-71bb6d3d57d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.819945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23136e-bef8-4eed-bafe-f70ef6367d5d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.820240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23136e-bef8-4eed-bafe-f70ef6367d5d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.820496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23136e-bef8-4eed-bafe-f70ef6367d5d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.821826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 12/23] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:47.826725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-bb6ff0de-bd3a-410a-90b4-71bb6d3d57d0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:47.828211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bb6ff0de-bd3a-410a-90b4-71bb6d3d57d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:47.831366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101ac9c-ac13-4bcb-b873-fdc39c3e1e71 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.831661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101ac9c-ac13-4bcb-b873-fdc39c3e1e71 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.832832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101ac9c-ac13-4bcb-b873-fdc39c3e1e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.866265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6101ac9c-ac13-4bcb-b873-fdc39c3e1e71 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:47.867592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6101ac9c-ac13-4bcb-b873-fdc39c3e1e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:47.984554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:48.008085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:48.086302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee79fe-359b-4b1a-b1fb-a4430ebc7a56 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.086943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee79fe-359b-4b1a-b1fb-a4430ebc7a56 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.087425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee79fe-359b-4b1a-b1fb-a4430ebc7a56 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.089295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:48.094988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3edbe-c4ce-4243-ab15-6fc4c95c7509 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.095509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3edbe-c4ce-4243-ab15-6fc4c95c7509 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.096002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3edbe-c4ce-4243-ab15-6fc4c95c7509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.124861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dba3edbe-c4ce-4243-ab15-6fc4c95c7509 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:48.124861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dba3edbe-c4ce-4243-ab15-6fc4c95c7509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:48.190076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.217976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:48.401989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee79fe-359b-4b1a-b1fb-a4430ebc7a56 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.490335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3edbe-c4ce-4243-ab15-6fc4c95c7509 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.494136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.536329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee79fe-359b-4b1a-b1fb-a4430ebc7a56 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.605064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d99eaf-f812-41ef-86de-181d2cc0e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.605994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d99eaf-f812-41ef-86de-181d2cc0e9bc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.606423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d99eaf-f812-41ef-86de-181d2cc0e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.607048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d99eaf-f812-41ef-86de-181d2cc0e9bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.632316 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d99eaf-f812-41ef-86de-181d2cc0e9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-03d99eaf-f812-41ef-86de-181d2cc0e9bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:48.641691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:48.642805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:48.643758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:25:48.646382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:48.647448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d99eaf-f812-41ef-86de-181d2cc0e9bc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.688140 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3edbe-c4ce-4243-ab15-6fc4c95c7509 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.760713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.761742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.762307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.762728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.765712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d99eaf-f812-41ef-86de-181d2cc0e9bc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.774152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.775985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:25:48.793617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:48.795609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:25:48.796423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:25:48.796423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:25:48.796423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:25:48.798291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:48.799114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.799756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.810546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebd03-d4ba-4924-8341-086fb98f8613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.811523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebd03-d4ba-4924-8341-086fb98f8613 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.811886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebd03-d4ba-4924-8341-086fb98f8613 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.812238 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebd03-d4ba-4924-8341-086fb98f8613 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.812997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bebd03-d4ba-4924-8341-086fb98f8613 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.814543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bebd03-d4ba-4924-8341-086fb98f8613 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.843274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.926308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4002-d46f-4b4e-8ffe-31396eff79cd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.963469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c098ca4-060c-4d90-bc83-d88fc883f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.964095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c098ca4-060c-4d90-bc83-d88fc883f945 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.964450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c098ca4-060c-4d90-bc83-d88fc883f945 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.964798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c098ca4-060c-4d90-bc83-d88fc883f945 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.965545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c098ca4-060c-4d90-bc83-d88fc883f945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:48.965947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c098ca4-060c-4d90-bc83-d88fc883f945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.967737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c098ca4-060c-4d90-bc83-d88fc883f945 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.968911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 15/30] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 15:25:48 2022] POST /identity/v3/roles => generated 219 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:48.970731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1c48-54d0-4ebe-93d2-f785db4c15e5 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.971465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1c48-54d0-4ebe-93d2-f785db4c15e5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.972015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1c48-54d0-4ebe-93d2-f785db4c15e5 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.973638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:48.974697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d1c48-54d0-4ebe-93d2-f785db4c15e5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.984087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:48.985520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a134d-e78c-417b-85d1-73583ae394e0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.985790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a134d-e78c-417b-85d1-73583ae394e0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.986371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a134d-e78c-417b-85d1-73583ae394e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.011218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5b9a134d-e78c-417b-85d1-73583ae394e0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:49.013474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5b9a134d-e78c-417b-85d1-73583ae394e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:49.125061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d1c48-54d0-4ebe-93d2-f785db4c15e5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.137880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:49.139722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a134d-e78c-417b-85d1-73583ae394e0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.174107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.189318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.190124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.190515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.190904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.191725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:49.192153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.193917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.226433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:49.246559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.313028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a134d-e78c-417b-85d1-73583ae394e0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.349226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.385617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9d839-3dde-46cb-bd7d-c1a0775cd377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.386294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d839-3dde-46cb-bd7d-c1a0775cd377 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.386582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d839-3dde-46cb-bd7d-c1a0775cd377 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.386864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9d839-3dde-46cb-bd7d-c1a0775cd377 None admin] PATH_INFO: `/v3/users/12ecd30dbfea46b7b32ac0a7df499823` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.395095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9d839-3dde-46cb-bd7d-c1a0775cd377 None admin] RBAC: Authorizing `identity:get_user(user_id=12ecd30dbfea46b7b32ac0a7df499823)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.396602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9d839-3dde-46cb-bd7d-c1a0775cd377 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.398317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:49 2022] GET /identity/v3/users/12ecd30dbfea46b7b32ac0a7df499823 => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:49.406331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9d839-3dde-46cb-bd7d-c1a0775cd377 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.445939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c7fdf-a088-4ca2-bd64-fd3e2515752a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.505219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd03cfc-cac1-4184-9afa-fcc67fdcdd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.505781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03cfc-cac1-4184-9afa-fcc67fdcdd9d None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.506117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03cfc-cac1-4184-9afa-fcc67fdcdd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.506476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03cfc-cac1-4184-9afa-fcc67fdcdd9d None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.507140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd03cfc-cac1-4184-9afa-fcc67fdcdd9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.508625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd03cfc-cac1-4184-9afa-fcc67fdcdd9d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.536645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.546400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 18/36] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:25:49 2022] POST /identity/v3/projects => generated 301 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:49.553935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12d4c-e672-49f3-9565-8d6a01afd707 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.554136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9d839-3dde-46cb-bd7d-c1a0775cd377 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.554217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12d4c-e672-49f3-9565-8d6a01afd707 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.554217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a12d4c-e672-49f3-9565-8d6a01afd707 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.554217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 19/37] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:49.554890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a12d4c-e672-49f3-9565-8d6a01afd707 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.588716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a849e1e-6dbe-408b-99b2-6e1bdea04926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.589486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a849e1e-6dbe-408b-99b2-6e1bdea04926 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.589775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a849e1e-6dbe-408b-99b2-6e1bdea04926 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.590087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a849e1e-6dbe-408b-99b2-6e1bdea04926 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.591578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a849e1e-6dbe-408b-99b2-6e1bdea04926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.593353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a849e1e-6dbe-408b-99b2-6e1bdea04926 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.595186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:49.596538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86200c3c-f17e-464f-a2b2-2530379b1541 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.596878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86200c3c-f17e-464f-a2b2-2530379b1541 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.597164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86200c3c-f17e-464f-a2b2-2530379b1541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.618884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-86200c3c-f17e-464f-a2b2-2530379b1541 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:49.620146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86200c3c-f17e-464f-a2b2-2530379b1541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:49.708580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:49.709719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86200c3c-f17e-464f-a2b2-2530379b1541 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.724914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a12d4c-e672-49f3-9565-8d6a01afd707 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.727360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.773677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240e375-4e0e-44f4-b209-5208acfdc6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.774540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e375-4e0e-44f4-b209-5208acfdc6ab None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.774976 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e375-4e0e-44f4-b209-5208acfdc6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.775963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e375-4e0e-44f4-b209-5208acfdc6ab None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.776821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240e375-4e0e-44f4-b209-5208acfdc6ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.778881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240e375-4e0e-44f4-b209-5208acfdc6ab None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.805793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 15:25:49 2022] POST /identity/v3/roles => generated 225 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:49.835547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdf787-b87f-4283-b663-11ae039b0458 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.835850 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdf787-b87f-4283-b663-11ae039b0458 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.836118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdf787-b87f-4283-b663-11ae039b0458 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.837513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 21/41] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:25:49.838086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.844052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86200c3c-f17e-464f-a2b2-2530379b1541 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.844390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa37a00-31b7-42b0-a5d6-553448ff1cb3 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.844684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa37a00-31b7-42b0-a5d6-553448ff1cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.844965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa37a00-31b7-42b0-a5d6-553448ff1cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.868862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-1fa37a00-31b7-42b0-a5d6-553448ff1cb3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:49.870717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1fa37a00-31b7-42b0-a5d6-553448ff1cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:49.891740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5f350-eb0d-476c-8651-4b48d299b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.892518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5f350-eb0d-476c-8651-4b48d299b06b None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.892802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5f350-eb0d-476c-8651-4b48d299b06b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.893080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5f350-eb0d-476c-8651-4b48d299b06b None admin] PATH_INFO: `/v3/domains/default/users/12ecd30dbfea46b7b32ac0a7df499823/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.895992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5f350-eb0d-476c-8651-4b48d299b06b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=12ecd30dbfea46b7b32ac0a7df499823, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.897597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5f350-eb0d-476c-8651-4b48d299b06b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.960726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 22/42] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:25:50.026154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa37a00-31b7-42b0-a5d6-553448ff1cb3 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:50.040056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 21/43] 10.222.0.20 () {58 vars in 1361 bytes} [Fri Aug 26 15:25:49 2022] PUT /identity/v3/domains/default/users/12ecd30dbfea46b7b32ac0a7df499823/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:25:50.241105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5f350-eb0d-476c-8651-4b48d299b06b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:50.254740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:50.266480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa37a00-31b7-42b0-a5d6-553448ff1cb3 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:50.307086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab930818-a5a9-45dd-a6e7-bf64d92be47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:50.307628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab930818-a5a9-45dd-a6e7-bf64d92be47b None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:50.307921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab930818-a5a9-45dd-a6e7-bf64d92be47b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:50.308231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab930818-a5a9-45dd-a6e7-bf64d92be47b None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:50.308910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab930818-a5a9-45dd-a6e7-bf64d92be47b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:50.310469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab930818-a5a9-45dd-a6e7-bf64d92be47b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:50.333958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 15:25:50 2022] POST /identity/v3/roles => generated 223 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:25:50.363033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5f350-eb0d-476c-8651-4b48d299b06b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:50.401497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2316c-cc7b-4100-be45-c6188a27127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:50.402188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2316c-cc7b-4100-be45-c6188a27127a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:50.402479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2316c-cc7b-4100-be45-c6188a27127a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:50.402759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2316c-cc7b-4100-be45-c6188a27127a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:50.404449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2316c-cc7b-4100-be45-c6188a27127a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:50.405830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2316c-cc7b-4100-be45-c6188a27127a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:50.410681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 22/45] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:50.416280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab930818-a5a9-45dd-a6e7-bf64d92be47b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:50.533735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab930818-a5a9-45dd-a6e7-bf64d92be47b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:50.570340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae8efc-677e-4a5c-8817-f4469638f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:50.570884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8efc-677e-4a5c-8817-f4469638f43c None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:50.571170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8efc-677e-4a5c-8817-f4469638f43c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:50.571449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8efc-677e-4a5c-8817-f4469638f43c None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:50.572106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae8efc-677e-4a5c-8817-f4469638f43c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:50.573561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae8efc-677e-4a5c-8817-f4469638f43c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:50.600326 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:25:50 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:52.014589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996ea6b-dbd1-48cc-a4ab-cd48ee9fe058 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.015119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996ea6b-dbd1-48cc-a4ab-cd48ee9fe058 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.015119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996ea6b-dbd1-48cc-a4ab-cd48ee9fe058 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.016491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:52.021620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd2bce-fe90-41c2-b776-c33f70d08d4f None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.022074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd2bce-fe90-41c2-b776-c33f70d08d4f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.022224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd2bce-fe90-41c2-b776-c33f70d08d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.029625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:52.041055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-78fd2bce-fe90-41c2-b776-c33f70d08d4f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:52.042292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-78fd2bce-fe90-41c2-b776-c33f70d08d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:52.109901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:52.389362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996ea6b-dbd1-48cc-a4ab-cd48ee9fe058 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.409453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:52.493562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996ea6b-dbd1-48cc-a4ab-cd48ee9fe058 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.515999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31095-343b-4ca5-806c-b321133f0528 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.516291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31095-343b-4ca5-806c-b321133f0528 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.516581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31095-343b-4ca5-806c-b321133f0528 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.517949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 26/49] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:25:52.522719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2ee98-133d-44d3-acbd-5a75d41e7831 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.523008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2ee98-133d-44d3-acbd-5a75d41e7831 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.523291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2ee98-133d-44d3-acbd-5a75d41e7831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.526876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13881-af57-4483-82ad-140bb64003c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.527507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13881-af57-4483-82ad-140bb64003c8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.527792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13881-af57-4483-82ad-140bb64003c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.528067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13881-af57-4483-82ad-140bb64003c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.540549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d13881-af57-4483-82ad-140bb64003c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:52.541218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-22b2ee98-133d-44d3-acbd-5a75d41e7831 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:52.542439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-22b2ee98-133d-44d3-acbd-5a75d41e7831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-01d13881-af57-4483-82ad-140bb64003c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:52.546551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:52.547586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:25:52.548357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 24/50] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:25:52.553441 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13881-af57-4483-82ad-140bb64003c8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.609356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 27/51] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:25:52.633498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:52.657102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13881-af57-4483-82ad-140bb64003c8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.690926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.691535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.691824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.692105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.692774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:52.693082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.694518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.703256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 25/52] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:52.708810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2ee98-133d-44d3-acbd-5a75d41e7831 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.770082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:52.807783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2ee98-133d-44d3-acbd-5a75d41e7831 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.840841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5448b59-aa90-4e01-8aa5-c104a4aef32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.842351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448b59-aa90-4e01-8aa5-c104a4aef32d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.842643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448b59-aa90-4e01-8aa5-c104a4aef32d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.842922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448b59-aa90-4e01-8aa5-c104a4aef32d None admin] PATH_INFO: `/v3/users/12ecd30dbfea46b7b32ac0a7df499823` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.844055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5448b59-aa90-4e01-8aa5-c104a4aef32d None admin] RBAC: Authorizing `identity:get_user(user_id=12ecd30dbfea46b7b32ac0a7df499823)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.845521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5448b59-aa90-4e01-8aa5-c104a4aef32d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.847116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 28/53] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/users/12ecd30dbfea46b7b32ac0a7df499823 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:52.852750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.878000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5448b59-aa90-4e01-8aa5-c104a4aef32d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.955876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e8cf4-47c6-4f38-9574-3b26d005745b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.982075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5448b59-aa90-4e01-8aa5-c104a4aef32d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.989184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f440ac8-44a2-4a85-b2e5-f034bbab5d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.989813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440ac8-44a2-4a85-b2e5-f034bbab5d50 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.990131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440ac8-44a2-4a85-b2e5-f034bbab5d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.990412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440ac8-44a2-4a85-b2e5-f034bbab5d50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.991556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f440ac8-44a2-4a85-b2e5-f034bbab5d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.993096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f440ac8-44a2-4a85-b2e5-f034bbab5d50 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.994707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:53.001197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f440ac8-44a2-4a85-b2e5-f034bbab5d50 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:53.011479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:53.011926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:53.017922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f53de0-f92b-4ee4-8530-4b627967e3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:53.018564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53de0-f92b-4ee4-8530-4b627967e3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:53.018850 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53de0-f92b-4ee4-8530-4b627967e3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:53.019127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f53de0-f92b-4ee4-8530-4b627967e3f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:53.020251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f53de0-f92b-4ee4-8530-4b627967e3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:53.021727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f53de0-f92b-4ee4-8530-4b627967e3f5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:53.023329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:53.028703 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f53de0-f92b-4ee4-8530-4b627967e3f5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:53.104139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f440ac8-44a2-4a85-b2e5-f034bbab5d50 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:53.128237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f53de0-f92b-4ee4-8530-4b627967e3f5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:53.138586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9abb0e-da71-4e97-a282-6fa69132af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:53.139205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abb0e-da71-4e97-a282-6fa69132af62 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:53.139484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abb0e-da71-4e97-a282-6fa69132af62 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:53.139858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9abb0e-da71-4e97-a282-6fa69132af62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:53.140597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9abb0e-da71-4e97-a282-6fa69132af62 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.domain.id=default, user.id=12ecd30dbfea46b7b32ac0a7df499823) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:53.140973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9abb0e-da71-4e97-a282-6fa69132af62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:53.142519 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9abb0e-da71-4e97-a282-6fa69132af62 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:53.148295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Aug 26 15:25:53 2022] GET /identity/v3/role_assignments?user.id=12ecd30dbfea46b7b32ac0a7df499823&scope.domain.id=default&role.id=cac8d7ae8325488684667d62304b0860 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:53.163927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15bb46-98d0-4d09-9a86-875ef380ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:53.164566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15bb46-98d0-4d09-9a86-875ef380ff81 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:53.164855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15bb46-98d0-4d09-9a86-875ef380ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:53.165138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15bb46-98d0-4d09-9a86-875ef380ff81 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:53.165810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15bb46-98d0-4d09-9a86-875ef380ff81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:53.167348 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15bb46-98d0-4d09-9a86-875ef380ff81 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:53.196495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Aug 26 15:25:53 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:25:55.122017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde43b9-bb29-4728-823a-14410c5e7e29 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:55.122640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde43b9-bb29-4728-823a-14410c5e7e29 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:55.122640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde43b9-bb29-4728-823a-14410c5e7e29 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:55.124132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:55.129243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799193-7d68-4bdc-ad7d-3b33cb23eb64 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:55.129611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799193-7d68-4bdc-ad7d-3b33cb23eb64 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:55.129802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799193-7d68-4bdc-ad7d-3b33cb23eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:55.148213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-01799193-7d68-4bdc-ad7d-3b33cb23eb64 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:55.149404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-01799193-7d68-4bdc-ad7d-3b33cb23eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:55.196291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:55.217809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:55.490158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde43b9-bb29-4728-823a-14410c5e7e29 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:55.561652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:55.592268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde43b9-bb29-4728-823a-14410c5e7e29 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:55.625307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f54f2-24d6-43e4-b9eb-75a11d90d08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:55.625947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f54f2-24d6-43e4-b9eb-75a11d90d08f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:55.626429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f54f2-24d6-43e4-b9eb-75a11d90d08f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:55.626798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f54f2-24d6-43e4-b9eb-75a11d90d08f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:55.627914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f54f2-24d6-43e4-b9eb-75a11d90d08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:55.629344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f54f2-24d6-43e4-b9eb-75a11d90d08f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:55.630913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:55.636450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799193-7d68-4bdc-ad7d-3b33cb23eb64 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:55.732805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799193-7d68-4bdc-ad7d-3b33cb23eb64 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:55.766271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1de7cb-7b63-40d4-8925-2aa80b61b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:55.766817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de7cb-7b63-40d4-8925-2aa80b61b2a4 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:55.767102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de7cb-7b63-40d4-8925-2aa80b61b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:55.767376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1de7cb-7b63-40d4-8925-2aa80b61b2a4 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:55.768022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1de7cb-7b63-40d4-8925-2aa80b61b2a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:55.769474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1de7cb-7b63-40d4-8925-2aa80b61b2a4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:55.796071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:25:55 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:58.823857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9d5c-26ea-43ef-8688-0154e09b4e2e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.823857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9d5c-26ea-43ef-8688-0154e09b4e2e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.823857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d9d5c-26ea-43ef-8688-0154e09b4e2e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.823857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:58.847982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87f491-8656-4d4a-8422-aacaa679125d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.848468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87f491-8656-4d4a-8422-aacaa679125d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.848569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87f491-8656-4d4a-8422-aacaa679125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.875652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-2b87f491-8656-4d4a-8422-aacaa679125d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:58.876877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2b87f491-8656-4d4a-8422-aacaa679125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:58.919843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:58.979215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:59.014555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaae7d-4d7d-44bb-8226-106ad96162a8 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.014840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaae7d-4d7d-44bb-8226-106ad96162a8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.015304 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaae7d-4d7d-44bb-8226-106ad96162a8 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.017104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 31/64] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:59.022584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303283a-70a3-49b7-a9ce-8da2be3e3eb0 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.022885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303283a-70a3-49b7-a9ce-8da2be3e3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.023168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303283a-70a3-49b7-a9ce-8da2be3e3eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.046378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-0303283a-70a3-49b7-a9ce-8da2be3e3eb0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:59.047803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0303283a-70a3-49b7-a9ce-8da2be3e3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:59.139972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 34/65] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:59.163858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052980-e878-4888-9c92-9c6b5c6f4191 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.164456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052980-e878-4888-9c92-9c6b5c6f4191 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.164933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052980-e878-4888-9c92-9c6b5c6f4191 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.166523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 32/66] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:59.182569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf65e-5449-4060-a8a8-c7f9817c8faf None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.182877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf65e-5449-4060-a8a8-c7f9817c8faf None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.183154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf65e-5449-4060-a8a8-c7f9817c8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.215979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-5accf65e-5449-4060-a8a8-c7f9817c8faf None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:59.216987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5accf65e-5449-4060-a8a8-c7f9817c8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:59.315511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:59.374240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f052980-e878-4888-9c92-9c6b5c6f4191 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.437733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6e76-5cce-4eea-aa9c-cd5b49316d5a None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.438360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6e76-5cce-4eea-aa9c-cd5b49316d5a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.438851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6e76-5cce-4eea-aa9c-cd5b49316d5a None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.440406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 36/68] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:59.445825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dd21-11f5-4422-9dbf-c1ec6c520dae None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.446367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dd21-11f5-4422-9dbf-c1ec6c520dae None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.446846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dd21-11f5-4422-9dbf-c1ec6c520dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.471866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b6e8dd21-11f5-4422-9dbf-c1ec6c520dae None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:59.473482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b6e8dd21-11f5-4422-9dbf-c1ec6c520dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:59.501450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.526272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f052980-e878-4888-9c92-9c6b5c6f4191 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.564718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7aabc-52f6-457e-a529-41148c1a6c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.565712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7aabc-52f6-457e-a529-41148c1a6c20 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.566240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7aabc-52f6-457e-a529-41148c1a6c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.566736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7aabc-52f6-457e-a529-41148c1a6c20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.571032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 37/69] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:25:59.571891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8dd21-11f5-4422-9dbf-c1ec6c520dae None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.576383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.581706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7aabc-52f6-457e-a529-41148c1a6c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-36d7aabc-52f6-457e-a529-41148c1a6c20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:59.586854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:59.587699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:25:59.588472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:25:59.590823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 33/70] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:25:59.600274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7aabc-52f6-457e-a529-41148c1a6c20 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.697366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8dd21-11f5-4422-9dbf-c1ec6c520dae None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.719357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7aabc-52f6-457e-a529-41148c1a6c20 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.732517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3806793-14d6-4409-98f8-d0a03b5584f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.733157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806793-14d6-4409-98f8-d0a03b5584f5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.733442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806793-14d6-4409-98f8-d0a03b5584f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.733714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806793-14d6-4409-98f8-d0a03b5584f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.744729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3806793-14d6-4409-98f8-d0a03b5584f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-a3806793-14d6-4409-98f8-d0a03b5584f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:59.752079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:59.752922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:59.753677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:25:59.755670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.756284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.756575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.756857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.757538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:59.758003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.758099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 38/71] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:59.759403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.759761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f74a3-1ac2-4126-8fec-24622b7c8080 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.760053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f74a3-1ac2-4126-8fec-24622b7c8080 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.760333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f74a3-1ac2-4126-8fec-24622b7c8080 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.765947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 39/72] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:59.765947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f74a3-1ac2-4126-8fec-24622b7c8080 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.769088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 34/73] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:59.770183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.792607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.837412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.878779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d16f16-68db-4527-a9dd-ba65f4d4cadc None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.882787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f74a3-1ac2-4126-8fec-24622b7c8080 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.912531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a0a4e-fd48-4335-8cb7-6f98569b0e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.913145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0a4e-fd48-4335-8cb7-6f98569b0e6d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.913433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0a4e-fd48-4335-8cb7-6f98569b0e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.913717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0a4e-fd48-4335-8cb7-6f98569b0e6d None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.914420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a0a4e-fd48-4335-8cb7-6f98569b0e6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:59.914733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a0a4e-fd48-4335-8cb7-6f98569b0e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.916135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a0a4e-fd48-4335-8cb7-6f98569b0e6d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.917029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb19d-daf8-45d6-9675-526ab7d84bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.917663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb19d-daf8-45d6-9675-526ab7d84bcd None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.917979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb19d-daf8-45d6-9675-526ab7d84bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.918267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcb19d-daf8-45d6-9675-526ab7d84bcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.924228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 35/74] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:59.925556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5774e-e09b-4e83-9354-a6982d74a54d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.925868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5774e-e09b-4e83-9354-a6982d74a54d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.926194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5774e-e09b-4e83-9354-a6982d74a54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.932446 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcb19d-daf8-45d6-9675-526ab7d84bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-2abcb19d-daf8-45d6-9675-526ab7d84bcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:59.938290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:59.939325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:25:59.940115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 40/75] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:59.940793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb19d-daf8-45d6-9675-526ab7d84bcd None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.946566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-93e5774e-e09b-4e83-9354-a6982d74a54d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:59.948132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-93e5774e-e09b-4e83-9354-a6982d74a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:00.015472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 36/76] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:00.024700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5774e-e09b-4e83-9354-a6982d74a54d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.026742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.043742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcb19d-daf8-45d6-9675-526ab7d84bcd None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.081720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.084817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadad7e3-dd3a-49d8-9534-b382fbe28189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.085771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadad7e3-dd3a-49d8-9534-b382fbe28189 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.086098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadad7e3-dd3a-49d8-9534-b382fbe28189 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.086372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadad7e3-dd3a-49d8-9534-b382fbe28189 None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.100583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadad7e3-dd3a-49d8-9534-b382fbe28189 None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.102121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadad7e3-dd3a-49d8-9534-b382fbe28189 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.109046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 41/77] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.109046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadad7e3-dd3a-49d8-9534-b382fbe28189 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.140730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5774e-e09b-4e83-9354-a6982d74a54d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.180814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181320df-6e5d-46cb-ad60-44aa224d6b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.181545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181320df-6e5d-46cb-ad60-44aa224d6b22 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.181938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181320df-6e5d-46cb-ad60-44aa224d6b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.182284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181320df-6e5d-46cb-ad60-44aa224d6b22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.193925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181320df-6e5d-46cb-ad60-44aa224d6b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-181320df-6e5d-46cb-ad60-44aa224d6b22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:00.198760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:00.199614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 37/78] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:00.202951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181320df-6e5d-46cb-ad60-44aa224d6b22 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.224922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadad7e3-dd3a-49d8-9534-b382fbe28189 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.263518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd233-8a15-4a7c-b0f6-5b97d22cf33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.264157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd233-8a15-4a7c-b0f6-5b97d22cf33d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.264480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd233-8a15-4a7c-b0f6-5b97d22cf33d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.264741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cd233-8a15-4a7c-b0f6-5b97d22cf33d None admin] PATH_INFO: `/v3/users/12ecd30dbfea46b7b32ac0a7df499823` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.266043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cd233-8a15-4a7c-b0f6-5b97d22cf33d None admin] RBAC: Authorizing `identity:get_user(user_id=12ecd30dbfea46b7b32ac0a7df499823)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.267546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cd233-8a15-4a7c-b0f6-5b97d22cf33d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.269283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 42/79] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/users/12ecd30dbfea46b7b32ac0a7df499823 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.274435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd233-8a15-4a7c-b0f6-5b97d22cf33d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.280087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.308139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181320df-6e5d-46cb-ad60-44aa224d6b22 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.322093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.342640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.343247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.343531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.343811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.344479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:00.344790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.346212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.354101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 38/80] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.355681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.379518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cd233-8a15-4a7c-b0f6-5b97d22cf33d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.413055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ce0a3-14e1-42db-9f50-72fc8caa89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.413666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ce0a3-14e1-42db-9f50-72fc8caa89d6 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.413985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ce0a3-14e1-42db-9f50-72fc8caa89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.414269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ce0a3-14e1-42db-9f50-72fc8caa89d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.458489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805ab50-d401-4bf3-9f47-ac9c3aad5102 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.482815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ce0a3-14e1-42db-9f50-72fc8caa89d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.484335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ce0a3-14e1-42db-9f50-72fc8caa89d6 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.487400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.492615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.493338 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.493699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.494009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.494678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:00.494986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.496345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.504491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 39/81] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.505480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.545749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.583987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 43/82] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:00.584937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ce0a3-14e1-42db-9f50-72fc8caa89d6 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.610463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2615-3f0f-469e-8866-6c10529e7e9e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.643670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab1b6-532c-4c4f-8dc7-56abfe82704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.644383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab1b6-532c-4c4f-8dc7-56abfe82704f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.644564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab1b6-532c-4c4f-8dc7-56abfe82704f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.644846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dab1b6-532c-4c4f-8dc7-56abfe82704f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.685916 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ce0a3-14e1-42db-9f50-72fc8caa89d6 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.688190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.711834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dab1b6-532c-4c4f-8dc7-56abfe82704f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.713227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dab1b6-532c-4c4f-8dc7-56abfe82704f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.725203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b866-87dd-4454-8258-a508d813ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.725864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b866-87dd-4454-8258-a508d813ee2a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.726169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b866-87dd-4454-8258-a508d813ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.726452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b866-87dd-4454-8258-a508d813ee2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.727569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605b866-87dd-4454-8258-a508d813ee2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.729032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605b866-87dd-4454-8258-a508d813ee2a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.730652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 44/83] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.732061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b866-87dd-4454-8258-a508d813ee2a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.752475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.812834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 40/84] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:00.814939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab1b6-532c-4c4f-8dc7-56abfe82704f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.833410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b866-87dd-4454-8258-a508d813ee2a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.869639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61d829-0308-4b12-9385-7937d5830624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.870310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61d829-0308-4b12-9385-7937d5830624 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.870599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61d829-0308-4b12-9385-7937d5830624 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.870888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61d829-0308-4b12-9385-7937d5830624 None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.872049 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61d829-0308-4b12-9385-7937d5830624 None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.873515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61d829-0308-4b12-9385-7937d5830624 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.875153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 45/85] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.878720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61d829-0308-4b12-9385-7937d5830624 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.914624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dab1b6-532c-4c4f-8dc7-56abfe82704f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.921149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.947187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8057a-9143-4395-ac26-0ec710789a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.947819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8057a-9143-4395-ac26-0ec710789a97 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.948109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8057a-9143-4395-ac26-0ec710789a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.948389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8057a-9143-4395-ac26-0ec710789a97 None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.949522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8057a-9143-4395-ac26-0ec710789a97 None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.951549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8057a-9143-4395-ac26-0ec710789a97 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.953156 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 41/86] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.953930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8057a-9143-4395-ac26-0ec710789a97 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.962119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.985297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61d829-0308-4b12-9385-7937d5830624 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.022084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288b218-5ee9-45fa-bca9-7009e6dee98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.022857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288b218-5ee9-45fa-bca9-7009e6dee98c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.023244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288b218-5ee9-45fa-bca9-7009e6dee98c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.023645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288b218-5ee9-45fa-bca9-7009e6dee98c None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.024869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288b218-5ee9-45fa-bca9-7009e6dee98c None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.026450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288b218-5ee9-45fa-bca9-7009e6dee98c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.028149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 46/87] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:01.028995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288b218-5ee9-45fa-bca9-7009e6dee98c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.134585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288b218-5ee9-45fa-bca9-7009e6dee98c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.145631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:01.169894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8057a-9143-4395-ac26-0ec710789a97 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.171590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d39284-352e-4cb9-98d4-dfa1dc37e500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.172223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39284-352e-4cb9-98d4-dfa1dc37e500 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.172502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39284-352e-4cb9-98d4-dfa1dc37e500 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.172827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39284-352e-4cb9-98d4-dfa1dc37e500 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.173908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d39284-352e-4cb9-98d4-dfa1dc37e500 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.175366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d39284-352e-4cb9-98d4-dfa1dc37e500 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.176987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 47/88] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:01.177744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d39284-352e-4cb9-98d4-dfa1dc37e500 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.205603 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edee55-8994-4086-b106-c94cf9051e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.206244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edee55-8994-4086-b106-c94cf9051e15 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.206530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edee55-8994-4086-b106-c94cf9051e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.206804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edee55-8994-4086-b106-c94cf9051e15 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.207445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edee55-8994-4086-b106-c94cf9051e15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.208910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edee55-8994-4086-b106-c94cf9051e15 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.237207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 42/89] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:00 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:01.237992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edee55-8994-4086-b106-c94cf9051e15 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.289271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d39284-352e-4cb9-98d4-dfa1dc37e500 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.311146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:01.329449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05693f-e2f8-4c13-94d9-e1476e4b0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.330218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05693f-e2f8-4c13-94d9-e1476e4b0374 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.330590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05693f-e2f8-4c13-94d9-e1476e4b0374 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.330978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05693f-e2f8-4c13-94d9-e1476e4b0374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.358061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edee55-8994-4086-b106-c94cf9051e15 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.382269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:01.398848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70669343-c276-4910-a76b-ac8f1b11ef23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.399466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70669343-c276-4910-a76b-ac8f1b11ef23 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.399745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70669343-c276-4910-a76b-ac8f1b11ef23 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.400019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70669343-c276-4910-a76b-ac8f1b11ef23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.418095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05693f-e2f8-4c13-94d9-e1476e4b0374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.420094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05693f-e2f8-4c13-94d9-e1476e4b0374 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.486353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70669343-c276-4910-a76b-ac8f1b11ef23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.487920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70669343-c276-4910-a76b-ac8f1b11ef23 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.545933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 48/90] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:01.547143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05693f-e2f8-4c13-94d9-e1476e4b0374 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.566221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:01.625719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 43/91] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:01.627270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70669343-c276-4910-a76b-ac8f1b11ef23 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.650711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:01.677406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05693f-e2f8-4c13-94d9-e1476e4b0374 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.716399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.717451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.717974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.718350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.719197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] RBAC: Adding query filter params (role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=60e78e00233e4cec80710a489bd078ea, user.id=a0856d72f27148cd8898e10ae2f22155) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:01.719675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.721211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.728767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 49/92] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/role_assignments?user.id=a0856d72f27148cd8898e10ae2f22155&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=a92b62fe43214de0b1468165da0d5456 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:01.729619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.737205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70669343-c276-4910-a76b-ac8f1b11ef23 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.776174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.777030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.777470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.777917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.779425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=60e78e00233e4cec80710a489bd078ea, user.id=12ecd30dbfea46b7b32ac0a7df499823) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:01.779924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.781596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.787768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 44/93] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/role_assignments?user.id=12ecd30dbfea46b7b32ac0a7df499823&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=cac8d7ae8325488684667d62304b0860 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:01.788819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.858245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:01.928341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b604d0d-1de9-4289-bf98-f746a4c14d50 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.998927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193ef2c-00c6-4326-97b1-7005f7e55846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.999587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ef2c-00c6-4326-97b1-7005f7e55846 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.999873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ef2c-00c6-4326-97b1-7005f7e55846 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:02.000155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ef2c-00c6-4326-97b1-7005f7e55846 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:02.002507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193ef2c-00c6-4326-97b1-7005f7e55846 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:02.005039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193ef2c-00c6-4326-97b1-7005f7e55846 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:02.008327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 50/94] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:02.009820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b0749-7a24-4290-ac09-eac2938be1b0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:02.017151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193ef2c-00c6-4326-97b1-7005f7e55846 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:02.032328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:02.088436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1693b93-56cd-483b-8480-3a0e57e064d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:02.089092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693b93-56cd-483b-8480-3a0e57e064d4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:02.089377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693b93-56cd-483b-8480-3a0e57e064d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:02.089659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693b93-56cd-483b-8480-3a0e57e064d4 None admin] PATH_INFO: `/v3/projects/f794fab9a99f4cec859475c3705812ef` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:02.092877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1693b93-56cd-483b-8480-3a0e57e064d4 None admin] RBAC: Authorizing `identity:get_project(project_id=f794fab9a99f4cec859475c3705812ef)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:02.094391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1693b93-56cd-483b-8480-3a0e57e064d4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:02.096074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 45/95] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/projects/f794fab9a99f4cec859475c3705812ef => generated 312 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:02.101944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1693b93-56cd-483b-8480-3a0e57e064d4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:02.186877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193ef2c-00c6-4326-97b1-7005f7e55846 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:02.223247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d18435-4b55-4ffc-9613-01931a07a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:02.223865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18435-4b55-4ffc-9613-01931a07a3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:02.224157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18435-4b55-4ffc-9613-01931a07a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:02.224439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d18435-4b55-4ffc-9613-01931a07a3e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:02.225184 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d18435-4b55-4ffc-9613-01931a07a3e1 None admin] RBAC: Adding query filter params (role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=60e78e00233e4cec80710a489bd078ea, user.id=a0856d72f27148cd8898e10ae2f22155) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:02.225505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d18435-4b55-4ffc-9613-01931a07a3e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:02.227028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d18435-4b55-4ffc-9613-01931a07a3e1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:02.233686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 51/96] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:02 2022] GET /identity/v3/role_assignments?user.id=a0856d72f27148cd8898e10ae2f22155&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:02.316449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:02.328372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1693b93-56cd-483b-8480-3a0e57e064d4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:02.376790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff71da6-894b-41fe-acc7-a13a868755ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:02.377412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71da6-894b-41fe-acc7-a13a868755ac None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:02.377693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71da6-894b-41fe-acc7-a13a868755ac None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:02.377996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff71da6-894b-41fe-acc7-a13a868755ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:02.378737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff71da6-894b-41fe-acc7-a13a868755ac None admin] RBAC: Adding query filter params (role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=f794fab9a99f4cec859475c3705812ef, user.id=a0856d72f27148cd8898e10ae2f22155) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:02.379048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff71da6-894b-41fe-acc7-a13a868755ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:02.380503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff71da6-894b-41fe-acc7-a13a868755ac None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:02.391307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 46/97] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:02 2022] GET /identity/v3/role_assignments?user.id=a0856d72f27148cd8898e10ae2f22155&scope.project.id=f794fab9a99f4cec859475c3705812ef&role.id=a92b62fe43214de0b1468165da0d5456 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:03.865545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f8aba-7031-4ed3-828f-b37cc7fe8bbe None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.866109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f8aba-7031-4ed3-828f-b37cc7fe8bbe None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.866109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f8aba-7031-4ed3-828f-b37cc7fe8bbe None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.867491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 52/98] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:03.881659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50c93-98f8-4178-99dc-6003ed9c48bd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.882136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50c93-98f8-4178-99dc-6003ed9c48bd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.882314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50c93-98f8-4178-99dc-6003ed9c48bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.900340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c6d50c93-98f8-4178-99dc-6003ed9c48bd None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:03.901551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c6d50c93-98f8-4178-99dc-6003ed9c48bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:03.975003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 47/99] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:04.271156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f8aba-7031-4ed3-828f-b37cc7fe8bbe None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.352295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.390677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f8aba-7031-4ed3-828f-b37cc7fe8bbe None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.426140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511d975-ae65-40dd-ad95-759a5591f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.426791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511d975-ae65-40dd-ad95-759a5591f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.427366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511d975-ae65-40dd-ad95-759a5591f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.427653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511d975-ae65-40dd-ad95-759a5591f4a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.439581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511d975-ae65-40dd-ad95-759a5591f4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-5511d975-ae65-40dd-ad95-759a5591f4a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:04.444458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:04.445354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:04.446173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 53/100] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:04.453581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50c93-98f8-4178-99dc-6003ed9c48bd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.574152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74720d2-28e9-457a-8fb7-514bc99bb60c None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.574518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74720d2-28e9-457a-8fb7-514bc99bb60c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.574726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74720d2-28e9-457a-8fb7-514bc99bb60c None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.576441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 54/101] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:04.582254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f83b2-d85a-4988-a48e-bf0304ad2786 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.582547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f83b2-d85a-4988-a48e-bf0304ad2786 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.582836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f83b2-d85a-4988-a48e-bf0304ad2786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.584715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.603832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50c93-98f8-4178-99dc-6003ed9c48bd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.619702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-6d4f83b2-d85a-4988-a48e-bf0304ad2786 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:04.621222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6d4f83b2-d85a-4988-a48e-bf0304ad2786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:04.661948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e71ea-a4ee-47e3-8cd3-78ff8283d374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.661948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e71ea-a4ee-47e3-8cd3-78ff8283d374 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.661948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e71ea-a4ee-47e3-8cd3-78ff8283d374 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.661948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e71ea-a4ee-47e3-8cd3-78ff8283d374 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.662308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e71ea-a4ee-47e3-8cd3-78ff8283d374 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:04.662308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e71ea-a4ee-47e3-8cd3-78ff8283d374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:04.662952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e71ea-a4ee-47e3-8cd3-78ff8283d374 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:04.672393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 48/102] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:04.674032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f858da-ed16-4a2a-b5e3-eeec0ab4ebc9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.674032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f858da-ed16-4a2a-b5e3-eeec0ab4ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.674032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f858da-ed16-4a2a-b5e3-eeec0ab4ebc9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.676502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 49/103] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:04.687360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a6a60-eaa2-4509-a9ac-67b3eaa9b7a2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.687652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a6a60-eaa2-4509-a9ac-67b3eaa9b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.687933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a6a60-eaa2-4509-a9ac-67b3eaa9b7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.712220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4f4a6a60-eaa2-4509-a9ac-67b3eaa9b7a2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:04.713516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4f4a6a60-eaa2-4509-a9ac-67b3eaa9b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:04.725606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 55/104] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:04.726797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f83b2-d85a-4988-a48e-bf0304ad2786 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.786655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 50/105] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:04.829532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.837410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db779-ec62-43c2-8e40-bac7460fceb3 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.837740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db779-ec62-43c2-8e40-bac7460fceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.838002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db779-ec62-43c2-8e40-bac7460fceb3 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.839518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 51/106] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:04.845151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116e05-90f7-43d5-b629-d40dc1258384 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.845151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116e05-90f7-43d5-b629-d40dc1258384 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.845372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0116e05-90f7-43d5-b629-d40dc1258384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.878369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c0116e05-90f7-43d5-b629-d40dc1258384 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:04.879629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0116e05-90f7-43d5-b629-d40dc1258384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:04.909641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f83b2-d85a-4988-a48e-bf0304ad2786 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.985550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 52/107] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:05.003135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1379e-705e-4b5d-9bc7-6d9fb4c5dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.003803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1379e-705e-4b5d-9bc7-6d9fb4c5dee7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.004091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1379e-705e-4b5d-9bc7-6d9fb4c5dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.004376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1379e-705e-4b5d-9bc7-6d9fb4c5dee7 None admin] PATH_INFO: `/v3/users/1d69f69eb6de457186837b098c8b50aa` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.038570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1379e-705e-4b5d-9bc7-6d9fb4c5dee7 None admin] RBAC: Authorizing `identity:get_user(user_id=1d69f69eb6de457186837b098c8b50aa)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.040089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1379e-705e-4b5d-9bc7-6d9fb4c5dee7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.041983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 56/108] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/users/1d69f69eb6de457186837b098c8b50aa => generated 289 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.047793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116e05-90f7-43d5-b629-d40dc1258384 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.078037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.170646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0116e05-90f7-43d5-b629-d40dc1258384 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.174607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1379e-705e-4b5d-9bc7-6d9fb4c5dee7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.207651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d31b68-49f8-4665-8253-a795439a2bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.208126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d31b68-49f8-4665-8253-a795439a2bca None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.213908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d31b68-49f8-4665-8253-a795439a2bca None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.213908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d31b68-49f8-4665-8253-a795439a2bca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.280384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d31b68-49f8-4665-8253-a795439a2bca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.281893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d31b68-49f8-4665-8253-a795439a2bca None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.310421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.393511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 53/109] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:05.394820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefd673-99d2-4e45-993b-60b5047c162a None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.395308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefd673-99d2-4e45-993b-60b5047c162a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.395740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefd673-99d2-4e45-993b-60b5047c162a None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.396114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1379e-705e-4b5d-9bc7-6d9fb4c5dee7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.397306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 54/110] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:05.398197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefd673-99d2-4e45-993b-60b5047c162a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.422086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.439140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d2519-ea5a-48a1-aff4-dc7909b8c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.440097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2519-ea5a-48a1-aff4-dc7909b8c705 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.440383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2519-ea5a-48a1-aff4-dc7909b8c705 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.440844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d2519-ea5a-48a1-aff4-dc7909b8c705 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.453276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d2519-ea5a-48a1-aff4-dc7909b8c705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-e75d2519-ea5a-48a1-aff4-dc7909b8c705 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:05.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:05.459212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:05.460000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:05.461948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 57/111] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:05.462881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d2519-ea5a-48a1-aff4-dc7909b8c705 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.513988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefd673-99d2-4e45-993b-60b5047c162a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.524280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.549188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c232311-e326-4d92-8255-f0d945257634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.549746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c232311-e326-4d92-8255-f0d945257634 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.550059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c232311-e326-4d92-8255-f0d945257634 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.550337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c232311-e326-4d92-8255-f0d945257634 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.560758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c232311-e326-4d92-8255-f0d945257634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5c232311-e326-4d92-8255-f0d945257634 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:05.565509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:05.566397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:05.567173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:05.567760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d2519-ea5a-48a1-aff4-dc7909b8c705 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.567830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:05.567830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c232311-e326-4d92-8255-f0d945257634 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.600522 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79592a0-d0a4-441f-9642-21b2323ad9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.601325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79592a0-d0a4-441f-9642-21b2323ad9ed None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.601623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79592a0-d0a4-441f-9642-21b2323ad9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.601934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79592a0-d0a4-441f-9642-21b2323ad9ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.603051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79592a0-d0a4-441f-9642-21b2323ad9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.604518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79592a0-d0a4-441f-9642-21b2323ad9ed None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.606646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 58/113] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.607995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12b74-5445-4709-b3a0-1463e39ca76c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.608291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12b74-5445-4709-b3a0-1463e39ca76c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.608574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12b74-5445-4709-b3a0-1463e39ca76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.626451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-24c12b74-5445-4709-b3a0-1463e39ca76c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:05.627686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-24c12b74-5445-4709-b3a0-1463e39ca76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:05.671777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.678079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c232311-e326-4d92-8255-f0d945257634 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.695485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 59/114] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:05.709981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12b74-5445-4709-b3a0-1463e39ca76c None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.717871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e411d-7203-4cde-ac21-79916544c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.717871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e411d-7203-4cde-ac21-79916544c333 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.717871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e411d-7203-4cde-ac21-79916544c333 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.717871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e411d-7203-4cde-ac21-79916544c333 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.718254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e411d-7203-4cde-ac21-79916544c333 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.718254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e411d-7203-4cde-ac21-79916544c333 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.718254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 56/115] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.718254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40954-6587-48a1-b132-e6a79f8bed78 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.718254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40954-6587-48a1-b132-e6a79f8bed78 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.718596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40954-6587-48a1-b132-e6a79f8bed78 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.719494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 57/116] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:05.720198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc40954-6587-48a1-b132-e6a79f8bed78 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.771083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.823339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12b74-5445-4709-b3a0-1463e39ca76c None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.836626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc40954-6587-48a1-b132-e6a79f8bed78 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.859467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.860079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.860364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.860644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.861573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:05.861994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.863389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.871611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.872619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 60/117] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.873506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.877512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.877814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.878121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.878806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:05.879115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.880563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.889832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 58/118] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.889832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.925715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.990675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84980-6fe3-4bda-9f64-a5d780a73d58 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.991957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.995114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a54af-efe4-4f31-9dd2-041d1efe93df None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.025571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec6297-2d32-4ccd-a63f-4e1e446e1179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.026231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec6297-2d32-4ccd-a63f-4e1e446e1179 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.026515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec6297-2d32-4ccd-a63f-4e1e446e1179 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.026792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec6297-2d32-4ccd-a63f-4e1e446e1179 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.027428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec6297-2d32-4ccd-a63f-4e1e446e1179 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.029036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec6297-2d32-4ccd-a63f-4e1e446e1179 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.030489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b121b2-e0ff-430b-a35d-5db51609846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.031101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b121b2-e0ff-430b-a35d-5db51609846e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.031389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b121b2-e0ff-430b-a35d-5db51609846e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.031669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b121b2-e0ff-430b-a35d-5db51609846e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.032403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b121b2-e0ff-430b-a35d-5db51609846e None admin] RBAC: Adding query filter params (role.id=6e8157956e274229a88aa603c4957f33, scope.project.id=60e78e00233e4cec80710a489bd078ea, user.id=1d69f69eb6de457186837b098c8b50aa) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:06.032717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b121b2-e0ff-430b-a35d-5db51609846e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.034216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b121b2-e0ff-430b-a35d-5db51609846e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.039473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 59/119] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/role_assignments?user.id=1d69f69eb6de457186837b098c8b50aa&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=6e8157956e274229a88aa603c4957f33 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.040765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898397c-f59e-4b67-92ba-fb7c4e319e8c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.041062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898397c-f59e-4b67-92ba-fb7c4e319e8c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.041349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898397c-f59e-4b67-92ba-fb7c4e319e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.062294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 61/120] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:26:05 2022] POST /identity/v3/projects => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:06.063037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec6297-2d32-4ccd-a63f-4e1e446e1179 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.066663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9898397c-f59e-4b67-92ba-fb7c4e319e8c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:06.067913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9898397c-f59e-4b67-92ba-fb7c4e319e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:06.163987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 60/121] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:06.164904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898397c-f59e-4b67-92ba-fb7c4e319e8c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.209911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.234227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec6297-2d32-4ccd-a63f-4e1e446e1179 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.293489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.300829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432c4e-4333-425b-bbfb-2c7ec00d2077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.301489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432c4e-4333-425b-bbfb-2c7ec00d2077 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.301784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432c4e-4333-425b-bbfb-2c7ec00d2077 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.302148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8432c4e-4333-425b-bbfb-2c7ec00d2077 None admin] PATH_INFO: `/v3/users/12ecd30dbfea46b7b32ac0a7df499823` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.303323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432c4e-4333-425b-bbfb-2c7ec00d2077 None admin] RBAC: Authorizing `identity:get_user(user_id=12ecd30dbfea46b7b32ac0a7df499823)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.303612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898397c-f59e-4b67-92ba-fb7c4e319e8c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.304809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8432c4e-4333-425b-bbfb-2c7ec00d2077 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.307302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 62/122] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/users/12ecd30dbfea46b7b32ac0a7df499823 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.315002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432c4e-4333-425b-bbfb-2c7ec00d2077 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.346400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce856f-4d7a-4b99-b427-767c1b4805de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.346805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce856f-4d7a-4b99-b427-767c1b4805de None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.347152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce856f-4d7a-4b99-b427-767c1b4805de None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.347528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce856f-4d7a-4b99-b427-767c1b4805de None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.348864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce856f-4d7a-4b99-b427-767c1b4805de None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.350538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce856f-4d7a-4b99-b427-767c1b4805de None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.352766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 61/123] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.353473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce856f-4d7a-4b99-b427-767c1b4805de None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.468078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8432c4e-4333-425b-bbfb-2c7ec00d2077 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.509102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce856f-4d7a-4b99-b427-767c1b4805de None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.516767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92755c-e82f-49da-8c9b-bd5e9b7e092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.517515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92755c-e82f-49da-8c9b-bd5e9b7e092d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.517803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92755c-e82f-49da-8c9b-bd5e9b7e092d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.518152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92755c-e82f-49da-8c9b-bd5e9b7e092d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.530033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92755c-e82f-49da-8c9b-bd5e9b7e092d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-2b92755c-e82f-49da-8c9b-bd5e9b7e092d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:06.537175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:06.538153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:06.538926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 63/124] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:06.539563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92755c-e82f-49da-8c9b-bd5e9b7e092d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.548599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400eccd-4c08-4d6e-898d-815348ab0e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.549551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400eccd-4c08-4d6e-898d-815348ab0e75 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.550057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400eccd-4c08-4d6e-898d-815348ab0e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.550557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400eccd-4c08-4d6e-898d-815348ab0e75 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.551910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400eccd-4c08-4d6e-898d-815348ab0e75 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.553555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400eccd-4c08-4d6e-898d-815348ab0e75 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.555474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 62/125] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.556436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400eccd-4c08-4d6e-898d-815348ab0e75 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.582254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.590501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.664234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92755c-e82f-49da-8c9b-bd5e9b7e092d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.674675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400eccd-4c08-4d6e-898d-815348ab0e75 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.701598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3315-43ac-41da-8f82-bcadaf9894b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.702269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3315-43ac-41da-8f82-bcadaf9894b8 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.702631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3315-43ac-41da-8f82-bcadaf9894b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.702884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3315-43ac-41da-8f82-bcadaf9894b8 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.704118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3315-43ac-41da-8f82-bcadaf9894b8 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.705809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3315-43ac-41da-8f82-bcadaf9894b8 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.707484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 64/126] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.708621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3315-43ac-41da-8f82-bcadaf9894b8 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.717796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61d50-accf-4863-baf1-279eee99ea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.718619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61d50-accf-4863-baf1-279eee99ea26 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.718909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61d50-accf-4863-baf1-279eee99ea26 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.719252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad61d50-accf-4863-baf1-279eee99ea26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.730215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad61d50-accf-4863-baf1-279eee99ea26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-dad61d50-accf-4863-baf1-279eee99ea26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:06.735714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:06.736961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:06.737953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 63/127] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:06.738605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61d50-accf-4863-baf1-279eee99ea26 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.837056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.852901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3315-43ac-41da-8f82-bcadaf9894b8 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.860029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.873935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad61d50-accf-4863-baf1-279eee99ea26 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.893431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.894176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.894457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.894733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.895453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:06.895763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.897263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.907247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 65/128] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.908039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.924734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610ac73-a152-4d5f-9859-07d9c596b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.925655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610ac73-a152-4d5f-9859-07d9c596b2a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.926448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610ac73-a152-4d5f-9859-07d9c596b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.926737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610ac73-a152-4d5f-9859-07d9c596b2a7 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea/users/12ecd30dbfea46b7b32ac0a7df499823/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.929531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610ac73-a152-4d5f-9859-07d9c596b2a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=60e78e00233e4cec80710a489bd078ea, user_id=12ecd30dbfea46b7b32ac0a7df499823, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.931065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610ac73-a152-4d5f-9859-07d9c596b2a7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.947458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 64/129] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:06 2022] PUT /identity/v3/projects/60e78e00233e4cec80710a489bd078ea/users/12ecd30dbfea46b7b32ac0a7df499823/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:06.948327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610ac73-a152-4d5f-9859-07d9c596b2a7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.079645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610ac73-a152-4d5f-9859-07d9c596b2a7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.095725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c80cc-c414-494f-a3d1-304bd001bac5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.123201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.124163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.124510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.124791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.125766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:07.126125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.128264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.141918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:07.142808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.174304 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:07.206723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63baa90-fa1e-40b1-bc1a-9b79d4fcb971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.207403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63baa90-fa1e-40b1-bc1a-9b79d4fcb971 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.207684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63baa90-fa1e-40b1-bc1a-9b79d4fcb971 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.207963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63baa90-fa1e-40b1-bc1a-9b79d4fcb971 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea/users/a0856d72f27148cd8898e10ae2f22155/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.210215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63baa90-fa1e-40b1-bc1a-9b79d4fcb971 None admin] RBAC: Authorizing `identity:create_grant(project_id=60e78e00233e4cec80710a489bd078ea, user_id=a0856d72f27148cd8898e10ae2f22155, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.211814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63baa90-fa1e-40b1-bc1a-9b79d4fcb971 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.240751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 66/131] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:06 2022] PUT /identity/v3/projects/60e78e00233e4cec80710a489bd078ea/users/a0856d72f27148cd8898e10ae2f22155/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:07.241455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63baa90-fa1e-40b1-bc1a-9b79d4fcb971 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.263568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:07.273325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adc3e2-0229-4e53-91ee-15007367f7ff None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.324526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb850-dcd7-4dc4-b53f-3b70ccb51c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.325769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb850-dcd7-4dc4-b53f-3b70ccb51c74 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.326091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb850-dcd7-4dc4-b53f-3b70ccb51c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.326374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfb850-dcd7-4dc4-b53f-3b70ccb51c74 None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.328857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb850-dcd7-4dc4-b53f-3b70ccb51c74 None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.330804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfb850-dcd7-4dc4-b53f-3b70ccb51c74 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.333009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 66/132] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:07 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:07.338810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb850-dcd7-4dc4-b53f-3b70ccb51c74 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.426671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63baa90-fa1e-40b1-bc1a-9b79d4fcb971 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.502361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:07.504623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ecaf3-448d-4c8a-8769-324b3f85559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.505289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ecaf3-448d-4c8a-8769-324b3f85559b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.505579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ecaf3-448d-4c8a-8769-324b3f85559b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.505878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ecaf3-448d-4c8a-8769-324b3f85559b None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.507902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ecaf3-448d-4c8a-8769-324b3f85559b None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.509394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ecaf3-448d-4c8a-8769-324b3f85559b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.511067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 67/133] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:07 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:07.518763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ecaf3-448d-4c8a-8769-324b3f85559b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.553056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfb850-dcd7-4dc4-b53f-3b70ccb51c74 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.623674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54deb-076f-4f73-9a96-ef1a2cba4d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.624240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54deb-076f-4f73-9a96-ef1a2cba4d70 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.624531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54deb-076f-4f73-9a96-ef1a2cba4d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.624812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b54deb-076f-4f73-9a96-ef1a2cba4d70 None admin] PATH_INFO: `/v3/projects/f794fab9a99f4cec859475c3705812ef` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.626597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b54deb-076f-4f73-9a96-ef1a2cba4d70 None admin] RBAC: Authorizing `identity:get_project(project_id=f794fab9a99f4cec859475c3705812ef)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.628300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b54deb-076f-4f73-9a96-ef1a2cba4d70 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.633933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 67/134] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:07 2022] GET /identity/v3/projects/f794fab9a99f4cec859475c3705812ef => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:07.651714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54deb-076f-4f73-9a96-ef1a2cba4d70 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.654497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:07.679131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ecaf3-448d-4c8a-8769-324b3f85559b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.729034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a909-7e54-41c8-a33c-9a53e7c148a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.729034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a909-7e54-41c8-a33c-9a53e7c148a5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.729034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a909-7e54-41c8-a33c-9a53e7c148a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.729034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a909-7e54-41c8-a33c-9a53e7c148a5 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.734340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62a909-7e54-41c8-a33c-9a53e7c148a5 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.735825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62a909-7e54-41c8-a33c-9a53e7c148a5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.738267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 68/135] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:07 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:07.744945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a909-7e54-41c8-a33c-9a53e7c148a5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.915760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62a909-7e54-41c8-a33c-9a53e7c148a5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.943070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b54deb-076f-4f73-9a96-ef1a2cba4d70 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.985672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa781b-6661-4354-8841-902eda2bf83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.986626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa781b-6661-4354-8841-902eda2bf83f None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.986911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa781b-6661-4354-8841-902eda2bf83f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.987193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa781b-6661-4354-8841-902eda2bf83f None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea/users/a0856d72f27148cd8898e10ae2f22155/roles/2e0116277dbb4c08a7ca7e300f7faa53` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.991120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa781b-6661-4354-8841-902eda2bf83f None admin] RBAC: Authorizing `identity:create_grant(project_id=60e78e00233e4cec80710a489bd078ea, user_id=a0856d72f27148cd8898e10ae2f22155, role_id=2e0116277dbb4c08a7ca7e300f7faa53)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.992589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa781b-6661-4354-8841-902eda2bf83f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:08.004271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880bbc7-d87b-4ca3-9c79-52eceaf0b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:08.004949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880bbc7-d87b-4ca3-9c79-52eceaf0b03e None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.005232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880bbc7-d87b-4ca3-9c79-52eceaf0b03e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.005536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880bbc7-d87b-4ca3-9c79-52eceaf0b03e None admin] PATH_INFO: `/v3/projects/f794fab9a99f4cec859475c3705812ef/users/a0856d72f27148cd8898e10ae2f22155/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.007540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880bbc7-d87b-4ca3-9c79-52eceaf0b03e None admin] RBAC: Authorizing `identity:create_grant(project_id=f794fab9a99f4cec859475c3705812ef, user_id=a0856d72f27148cd8898e10ae2f22155, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:08.009252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880bbc7-d87b-4ca3-9c79-52eceaf0b03e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:08.014749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 69/136] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:07 2022] PUT /identity/v3/projects/60e78e00233e4cec80710a489bd078ea/users/a0856d72f27148cd8898e10ae2f22155/roles/2e0116277dbb4c08a7ca7e300f7faa53 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:26:08.036145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 68/137] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:07 2022] PUT /identity/v3/projects/f794fab9a99f4cec859475c3705812ef/users/a0856d72f27148cd8898e10ae2f22155/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:26:08.540745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe199de-bd69-4c79-98cf-72069cd9fbd9 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.541264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe199de-bd69-4c79-98cf-72069cd9fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.541337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe199de-bd69-4c79-98cf-72069cd9fbd9 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.542675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 70/138] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:08.551806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e2a27-8f9f-4284-a707-c9b20f062e61 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.552336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e2a27-8f9f-4284-a707-c9b20f062e61 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.552336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e2a27-8f9f-4284-a707-c9b20f062e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.562639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2612b2-1f2f-4313-82be-279ba75d4cc0 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.562938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2612b2-1f2f-4313-82be-279ba75d4cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.563227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2612b2-1f2f-4313-82be-279ba75d4cc0 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.564607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 71/139] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:08.569624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c50d-40af-4037-9040-086f0b182725 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.569950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c50d-40af-4037-9040-086f0b182725 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.570236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c50d-40af-4037-9040-086f0b182725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.582887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-809e2a27-8f9f-4284-a707-c9b20f062e61 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:08.584157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:08.585111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-809e2a27-8f9f-4284-a707-c9b20f062e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:08.587346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:08.597809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-87c5c50d-40af-4037-9040-086f0b182725 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:08.599066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-87c5c50d-40af-4037-9040-086f0b182725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:08.688018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 69/140] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:08.738928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 72/141] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:09.061422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e2a27-8f9f-4284-a707-c9b20f062e61 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.221915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e2a27-8f9f-4284-a707-c9b20f062e61 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.264103 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1144662-0188-4b22-a5cd-5bfff79f56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.265115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144662-0188-4b22-a5cd-5bfff79f56d1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.265601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144662-0188-4b22-a5cd-5bfff79f56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.270141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144662-0188-4b22-a5cd-5bfff79f56d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.278062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:09.284141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1144662-0188-4b22-a5cd-5bfff79f56d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c1144662-0188-4b22-a5cd-5bfff79f56d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:09.289210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:09.290303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:09.291081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:09.293148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 70/142] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:09.299881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c50d-40af-4037-9040-086f0b182725 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.301483 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1144662-0188-4b22-a5cd-5bfff79f56d1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.464466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1144662-0188-4b22-a5cd-5bfff79f56d1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.518021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c50d-40af-4037-9040-086f0b182725 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.550541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933899-92f8-475a-8c4a-ba790120ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.551185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933899-92f8-475a-8c4a-ba790120ad08 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.551469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933899-92f8-475a-8c4a-ba790120ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.551741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933899-92f8-475a-8c4a-ba790120ad08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.552874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933899-92f8-475a-8c4a-ba790120ad08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:09.554370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933899-92f8-475a-8c4a-ba790120ad08 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:09.556267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 71/143] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:09.557467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361003d-b9d3-499d-a03e-2827e1ce6987 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.557750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361003d-b9d3-499d-a03e-2827e1ce6987 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.558050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361003d-b9d3-499d-a03e-2827e1ce6987 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.559888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 72/144] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:09.561246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361003d-b9d3-499d-a03e-2827e1ce6987 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.568221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca524b-25e6-4a11-acf8-1e12d90b33fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.568848 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca524b-25e6-4a11-acf8-1e12d90b33fb None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.569134 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca524b-25e6-4a11-acf8-1e12d90b33fb None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.569410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca524b-25e6-4a11-acf8-1e12d90b33fb None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.570111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca524b-25e6-4a11-acf8-1e12d90b33fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:09.570415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca524b-25e6-4a11-acf8-1e12d90b33fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:09.571818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca524b-25e6-4a11-acf8-1e12d90b33fb None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:09.574403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:09.582332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 73/145] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:09.583546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46952ca-f6b1-426d-b205-429239a981eb None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.583834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46952ca-f6b1-426d-b205-429239a981eb None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.584114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46952ca-f6b1-426d-b205-429239a981eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.622545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b46952ca-f6b1-426d-b205-429239a981eb None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:09.623752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b46952ca-f6b1-426d-b205-429239a981eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:09.686192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:09.751999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 74/146] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:09.752576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46952ca-f6b1-426d-b205-429239a981eb None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.760694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361003d-b9d3-499d-a03e-2827e1ce6987 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.805355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0d547-6167-40f3-b072-b7e010cce5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.806896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0d547-6167-40f3-b072-b7e010cce5ac None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.807384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0d547-6167-40f3-b072-b7e010cce5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.807857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0d547-6167-40f3-b072-b7e010cce5ac None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.808870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0d547-6167-40f3-b072-b7e010cce5ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:09.810747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0d547-6167-40f3-b072-b7e010cce5ac None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:09.845077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 73/147] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:09 2022] POST /identity/v3/users => generated 283 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:26:09.983660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46952ca-f6b1-426d-b205-429239a981eb None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.028571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.038571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bb991-c9d1-4d69-aeba-01860234eb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.039381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bb991-c9d1-4d69-aeba-01860234eb33 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.039945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bb991-c9d1-4d69-aeba-01860234eb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.040217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bb991-c9d1-4d69-aeba-01860234eb33 None admin] PATH_INFO: `/v3/users/1d69f69eb6de457186837b098c8b50aa` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.041363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bb991-c9d1-4d69-aeba-01860234eb33 None admin] RBAC: Authorizing `identity:get_user(user_id=1d69f69eb6de457186837b098c8b50aa)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.042864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bb991-c9d1-4d69-aeba-01860234eb33 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.045719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 75/148] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/users/1d69f69eb6de457186837b098c8b50aa => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:10.051445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0d547-6167-40f3-b072-b7e010cce5ac None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.209811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bb991-c9d1-4d69-aeba-01860234eb33 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.237574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0d547-6167-40f3-b072-b7e010cce5ac None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.282286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.300548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d6826-125c-444b-930a-cf86f6ad016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.301196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6826-125c-444b-930a-cf86f6ad016a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.301480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6826-125c-444b-930a-cf86f6ad016a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.301758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d6826-125c-444b-930a-cf86f6ad016a None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.305653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d6826-125c-444b-930a-cf86f6ad016a None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.310532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d6826-125c-444b-930a-cf86f6ad016a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.312266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 74/149] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:10.339850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d6826-125c-444b-930a-cf86f6ad016a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.381585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bb991-c9d1-4d69-aeba-01860234eb33 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.433933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9458e3-2114-457e-b954-409766972429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.435226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9458e3-2114-457e-b954-409766972429 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.435712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9458e3-2114-457e-b954-409766972429 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.436041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9458e3-2114-457e-b954-409766972429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.460211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9458e3-2114-457e-b954-409766972429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-ec9458e3-2114-457e-b954-409766972429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:10.465593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:10.466525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:10.467318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:10.467972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 76/150] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:10.471400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccf7f3-f4b6-4c46-83ae-ed0d60d03354 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.471903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccf7f3-f4b6-4c46-83ae-ed0d60d03354 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.472460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccf7f3-f4b6-4c46-83ae-ed0d60d03354 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.473996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 77/151] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:10.475111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccf7f3-f4b6-4c46-83ae-ed0d60d03354 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.543351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d6826-125c-444b-930a-cf86f6ad016a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.559078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.590568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b323-f677-45c0-98ea-1deb1b01b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.591472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b323-f677-45c0-98ea-1deb1b01b3d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.591850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b323-f677-45c0-98ea-1deb1b01b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.592226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b323-f677-45c0-98ea-1deb1b01b3d6 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea/users/1d69f69eb6de457186837b098c8b50aa/roles/6e8157956e274229a88aa603c4957f33` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.594401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b323-f677-45c0-98ea-1deb1b01b3d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=60e78e00233e4cec80710a489bd078ea, user_id=1d69f69eb6de457186837b098c8b50aa, role_id=6e8157956e274229a88aa603c4957f33)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.596065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b323-f677-45c0-98ea-1deb1b01b3d6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.618725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 75/152] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:10 2022] PUT /identity/v3/projects/60e78e00233e4cec80710a489bd078ea/users/1d69f69eb6de457186837b098c8b50aa/roles/6e8157956e274229a88aa603c4957f33 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:26:10.618934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccf7f3-f4b6-4c46-83ae-ed0d60d03354 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.620410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca98a-19a3-4b67-9e8f-251f5aa8eba2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.620877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca98a-19a3-4b67-9e8f-251f5aa8eba2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.621365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ca98a-19a3-4b67-9e8f-251f5aa8eba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.647161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4f1ca98a-19a3-4b67-9e8f-251f5aa8eba2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:10.648534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4f1ca98a-19a3-4b67-9e8f-251f5aa8eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:10.666284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.667152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.667579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.668010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.669461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:10.670183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.671762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.680934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 78/153] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:10.688835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.721163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.752603 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 76/154] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:10.838756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3374d5-3ffc-4dd0-94fd-6b4e820f8198 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.864694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.885920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad658d-3fe5-40a8-be49-608e07a6b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.886560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad658d-3fe5-40a8-be49-608e07a6b420 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.886839 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad658d-3fe5-40a8-be49-608e07a6b420 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.887111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad658d-3fe5-40a8-be49-608e07a6b420 None admin] PATH_INFO: `/v3/users/12ecd30dbfea46b7b32ac0a7df499823` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.889018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad658d-3fe5-40a8-be49-608e07a6b420 None admin] RBAC: Authorizing `identity:get_user(user_id=12ecd30dbfea46b7b32ac0a7df499823)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.890531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad658d-3fe5-40a8-be49-608e07a6b420 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.892203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 79/155] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/users/12ecd30dbfea46b7b32ac0a7df499823 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:10.897950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ca98a-19a3-4b67-9e8f-251f5aa8eba2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.953469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2b80-1e91-4f86-99e4-ae7526e35654 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.953469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2b80-1e91-4f86-99e4-ae7526e35654 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.953469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2b80-1e91-4f86-99e4-ae7526e35654 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.954775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 80/156] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:10.961801 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5705-17d1-4d66-90c0-730984ff8230 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.962123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5705-17d1-4d66-90c0-730984ff8230 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.962400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5705-17d1-4d66-90c0-730984ff8230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.994986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-93cf5705-17d1-4d66-90c0-730984ff8230 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:10.998493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-93cf5705-17d1-4d66-90c0-730984ff8230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:11.060111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ca98a-19a3-4b67-9e8f-251f5aa8eba2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.141113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 81/157] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:11.144583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632223cb-41e2-42cb-ba47-d32a49cc86c7 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.145982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67454-5bed-456c-a842-efaeaae0e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.146832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67454-5bed-456c-a842-efaeaae0e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.147301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67454-5bed-456c-a842-efaeaae0e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.147771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67454-5bed-456c-a842-efaeaae0e9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.148749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632223cb-41e2-42cb-ba47-d32a49cc86c7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.151413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632223cb-41e2-42cb-ba47-d32a49cc86c7 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.153008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 82/158] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:11.159179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf52d-14e6-4ab9-a7c9-5c347a0519d2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.159456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf52d-14e6-4ab9-a7c9-5c347a0519d2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.159770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf52d-14e6-4ab9-a7c9-5c347a0519d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.194872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-89fdf52d-14e6-4ab9-a7c9-5c347a0519d2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:11.197105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-89fdf52d-14e6-4ab9-a7c9-5c347a0519d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:11.242353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.285421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67454-5bed-456c-a842-efaeaae0e9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.287063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67454-5bed-456c-a842-efaeaae0e9e8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.322271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 83/159] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:11.323181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdf52d-14e6-4ab9-a7c9-5c347a0519d2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.378661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.440100 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdf52d-14e6-4ab9-a7c9-5c347a0519d2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.478934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b739a37-a4bf-4b30-a050-503538e115fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.479578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b739a37-a4bf-4b30-a050-503538e115fc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.479859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b739a37-a4bf-4b30-a050-503538e115fc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.480133 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b739a37-a4bf-4b30-a050-503538e115fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.501579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b739a37-a4bf-4b30-a050-503538e115fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-7b739a37-a4bf-4b30-a050-503538e115fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:11.510687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:11.511610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:11.513385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 84/160] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:11.518813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b739a37-a4bf-4b30-a050-503538e115fc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.537500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 77/161] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:11.542877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67454-5bed-456c-a842-efaeaae0e9e8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.668136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.689515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67454-5bed-456c-a842-efaeaae0e9e8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.733143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74908c5f-1681-433d-bd21-9e96462d87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.733786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74908c5f-1681-433d-bd21-9e96462d87b1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.734171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74908c5f-1681-433d-bd21-9e96462d87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.734510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74908c5f-1681-433d-bd21-9e96462d87b1 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.735726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74908c5f-1681-433d-bd21-9e96462d87b1 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.737513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74908c5f-1681-433d-bd21-9e96462d87b1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.740040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 78/162] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:11.740788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74908c5f-1681-433d-bd21-9e96462d87b1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.764926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b739a37-a4bf-4b30-a050-503538e115fc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.784222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.842562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.843235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.843519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.843793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.844471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:11.846223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.846223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.863954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 85/163] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:11.864589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.949579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74908c5f-1681-433d-bd21-9e96462d87b1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.992727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3bc54-b361-490b-bce8-829641bb1d1a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.035898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.036883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.037383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.037897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.038967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=60e78e00233e4cec80710a489bd078ea, user.id=12ecd30dbfea46b7b32ac0a7df499823) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:12.039488 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.041259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.048126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801703a-280d-4757-a823-af6df16869e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.048126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801703a-280d-4757-a823-af6df16869e3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.048126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801703a-280d-4757-a823-af6df16869e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.048126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801703a-280d-4757-a823-af6df16869e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.054087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 86/164] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/role_assignments?user.id=12ecd30dbfea46b7b32ac0a7df499823&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=cac8d7ae8325488684667d62304b0860 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:12.055218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.078952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801703a-280d-4757-a823-af6df16869e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8801703a-280d-4757-a823-af6df16869e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:12.083834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:12.084709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:12.085509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 79/165] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:12.086442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801703a-280d-4757-a823-af6df16869e3 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.129332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.145661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.244485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9b1eb-ce8e-436c-a4e5-1edc98dfced5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.314592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9702a46-af40-4b6f-ac43-dc36ddf05547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.315247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9702a46-af40-4b6f-ac43-dc36ddf05547 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.315528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9702a46-af40-4b6f-ac43-dc36ddf05547 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.315799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9702a46-af40-4b6f-ac43-dc36ddf05547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.324915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801703a-280d-4757-a823-af6df16869e3 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.344905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9702a46-af40-4b6f-ac43-dc36ddf05547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-c9702a46-af40-4b6f-ac43-dc36ddf05547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:12.362859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:12.363817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:12.364631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:12.366800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 87/166] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:12.367638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9702a46-af40-4b6f-ac43-dc36ddf05547 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.434719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108433b5-fa28-49bc-a59e-2d2444456be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.435361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108433b5-fa28-49bc-a59e-2d2444456be5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.435645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108433b5-fa28-49bc-a59e-2d2444456be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.435912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108433b5-fa28-49bc-a59e-2d2444456be5 None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.438295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108433b5-fa28-49bc-a59e-2d2444456be5 None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.439912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108433b5-fa28-49bc-a59e-2d2444456be5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.442224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 80/167] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:12.443015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108433b5-fa28-49bc-a59e-2d2444456be5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.561709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.588430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108433b5-fa28-49bc-a59e-2d2444456be5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.618216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.632042 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.633090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.633561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.634054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.634265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9702a46-af40-4b6f-ac43-dc36ddf05547 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.635132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:12.635785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.637602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.650487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 81/168] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:12.651601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.718319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.719310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.719914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.721279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.723529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:12.724089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.725693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.744668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 88/169] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:12.745874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.832484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e181c1-d852-454f-ad55-dcca4e832e6f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.885504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7405-48e3-4036-9375-2ff7b4f3d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.886762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7405-48e3-4036-9375-2ff7b4f3d272 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.887801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7405-48e3-4036-9375-2ff7b4f3d272 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.888433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7405-48e3-4036-9375-2ff7b4f3d272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.899575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.999727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d7405-48e3-4036-9375-2ff7b4f3d272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.001595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d7405-48e3-4036-9375-2ff7b4f3d272 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.041942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adefa6f-4ac0-4899-afc5-8fcadc1d4436 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.116571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12204ffe-b082-415f-9b1f-513f2db3bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.117147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12204ffe-b082-415f-9b1f-513f2db3bb41 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.117432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12204ffe-b082-415f-9b1f-513f2db3bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.117698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12204ffe-b082-415f-9b1f-513f2db3bb41 None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.123005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12204ffe-b082-415f-9b1f-513f2db3bb41 None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.124505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12204ffe-b082-415f-9b1f-513f2db3bb41 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.126500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 89/170] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.127643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12204ffe-b082-415f-9b1f-513f2db3bb41 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.167326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 82/171] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:13.174191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7405-48e3-4036-9375-2ff7b4f3d272 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.178834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.232822 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.297970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7405-48e3-4036-9375-2ff7b4f3d272 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.334883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a9091-c56d-4c57-ad4c-0ac4d59c8612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.335539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9091-c56d-4c57-ad4c-0ac4d59c8612 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.335819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9091-c56d-4c57-ad4c-0ac4d59c8612 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.336091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9091-c56d-4c57-ad4c-0ac4d59c8612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.366461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12204ffe-b082-415f-9b1f-513f2db3bb41 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.411037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a9091-c56d-4c57-ad4c-0ac4d59c8612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.412534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a9091-c56d-4c57-ad4c-0ac4d59c8612 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.438611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4365d-ebb1-4f70-a7eb-7b71aacc809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.439640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4365d-ebb1-4f70-a7eb-7b71aacc809c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.440145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4365d-ebb1-4f70-a7eb-7b71aacc809c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.440645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4365d-ebb1-4f70-a7eb-7b71aacc809c None admin] PATH_INFO: `/v3/users/a0856d72f27148cd8898e10ae2f22155` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.442143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4365d-ebb1-4f70-a7eb-7b71aacc809c None admin] RBAC: Authorizing `identity:get_user(user_id=a0856d72f27148cd8898e10ae2f22155)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.443812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4365d-ebb1-4f70-a7eb-7b71aacc809c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.445618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 90/172] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/users/a0856d72f27148cd8898e10ae2f22155 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.451527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4365d-ebb1-4f70-a7eb-7b71aacc809c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.466204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.526015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 83/173] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:13.529816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a9091-c56d-4c57-ad4c-0ac4d59c8612 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.644383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a9091-c56d-4c57-ad4c-0ac4d59c8612 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.651587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.666719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4365d-ebb1-4f70-a7eb-7b71aacc809c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.688518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce89b6f-114e-43d1-9316-5f3e1dc42ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.690407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce89b6f-114e-43d1-9316-5f3e1dc42ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.690407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce89b6f-114e-43d1-9316-5f3e1dc42ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.690407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce89b6f-114e-43d1-9316-5f3e1dc42ce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.698850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.719564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac651a3-6c49-4932-bd2e-f2af9331f379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.720205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac651a3-6c49-4932-bd2e-f2af9331f379 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.720487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac651a3-6c49-4932-bd2e-f2af9331f379 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.720770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac651a3-6c49-4932-bd2e-f2af9331f379 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.722176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac651a3-6c49-4932-bd2e-f2af9331f379 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.723852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac651a3-6c49-4932-bd2e-f2af9331f379 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.725943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 91/174] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.726918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac651a3-6c49-4932-bd2e-f2af9331f379 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.783231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce89b6f-114e-43d1-9316-5f3e1dc42ce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.785008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce89b6f-114e-43d1-9316-5f3e1dc42ce5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.849674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac651a3-6c49-4932-bd2e-f2af9331f379 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.895246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 84/175] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:13.897208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab04c3-a0c0-4691-8618-7c520797b36f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.897685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab04c3-a0c0-4691-8618-7c520797b36f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.898193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab04c3-a0c0-4691-8618-7c520797b36f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.899916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 85/176] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:13.901125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94fadf-9bab-4492-8383-47f42d96ee9e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.901595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94fadf-9bab-4492-8383-47f42d96ee9e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.902081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94fadf-9bab-4492-8383-47f42d96ee9e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.904714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 86/177] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:13.905637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94fadf-9bab-4492-8383-47f42d96ee9e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.928576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab2135-7427-4e5d-a5db-d8659a877ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.929147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab2135-7427-4e5d-a5db-d8659a877ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.929432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab2135-7427-4e5d-a5db-d8659a877ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.929710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab2135-7427-4e5d-a5db-d8659a877ce2 None admin] PATH_INFO: `/v3/projects/f794fab9a99f4cec859475c3705812ef` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.932671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab2135-7427-4e5d-a5db-d8659a877ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=f794fab9a99f4cec859475c3705812ef)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.934814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab2135-7427-4e5d-a5db-d8659a877ce2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.936668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 92/178] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/projects/f794fab9a99f4cec859475c3705812ef => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.942227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab2135-7427-4e5d-a5db-d8659a877ce2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.970270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.985697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.086498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94fadf-9bab-4492-8383-47f42d96ee9e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.086986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab2135-7427-4e5d-a5db-d8659a877ce2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.139658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478f651-dddd-4e9a-b0f9-c87201d0c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.140471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f651-dddd-4e9a-b0f9-c87201d0c9fd None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.140856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f651-dddd-4e9a-b0f9-c87201d0c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.141234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478f651-dddd-4e9a-b0f9-c87201d0c9fd None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.142583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478f651-dddd-4e9a-b0f9-c87201d0c9fd None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.145091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478f651-dddd-4e9a-b0f9-c87201d0c9fd None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.146947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 93/179] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.149571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccee4-1d2e-41ce-8822-ca21274ab316 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.149866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccee4-1d2e-41ce-8822-ca21274ab316 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.151063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decccee4-1d2e-41ce-8822-ca21274ab316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.163526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf9f1a-a7a6-4115-b589-9b0eeba195cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.164148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9f1a-a7a6-4115-b589-9b0eeba195cd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.164432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9f1a-a7a6-4115-b589-9b0eeba195cd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.164704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf9f1a-a7a6-4115-b589-9b0eeba195cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.165437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf9f1a-a7a6-4115-b589-9b0eeba195cd None admin] RBAC: Adding query filter params (role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=60e78e00233e4cec80710a489bd078ea, user.id=a0856d72f27148cd8898e10ae2f22155) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:14.165747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf9f1a-a7a6-4115-b589-9b0eeba195cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.167212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf9f1a-a7a6-4115-b589-9b0eeba195cd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.188540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 87/180] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/role_assignments?user.id=a0856d72f27148cd8898e10ae2f22155&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=a92b62fe43214de0b1468165da0d5456 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.189724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dca790-1338-4215-a8f9-4e376d61b050 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.190051 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dca790-1338-4215-a8f9-4e376d61b050 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.194836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dca790-1338-4215-a8f9-4e376d61b050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.195002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-decccee4-1d2e-41ce-8822-ca21274ab316 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:14.195002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-decccee4-1d2e-41ce-8822-ca21274ab316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:14.230459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-85dca790-1338-4215-a8f9-4e376d61b050 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:14.233373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85dca790-1338-4215-a8f9-4e376d61b050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:14.343927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 94/181] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:14.345563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decccee4-1d2e-41ce-8822-ca21274ab316 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.393865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:14.398863 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dca790-1338-4215-a8f9-4e376d61b050 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.406223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.483037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.581825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decccee4-1d2e-41ce-8822-ca21274ab316 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.598288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dca790-1338-4215-a8f9-4e376d61b050 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.631468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9bc9c-f84e-4a5d-ac41-eef536184bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.632440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bc9c-f84e-4a5d-ac41-eef536184bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.632914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bc9c-f84e-4a5d-ac41-eef536184bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.633381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9bc9c-f84e-4a5d-ac41-eef536184bb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.634368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9bc9c-f84e-4a5d-ac41-eef536184bb7 None admin] RBAC: Adding query filter params (role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=f794fab9a99f4cec859475c3705812ef, user.id=a0856d72f27148cd8898e10ae2f22155) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:14.635057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9bc9c-f84e-4a5d-ac41-eef536184bb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.636737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9bc9c-f84e-4a5d-ac41-eef536184bb7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.644763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 95/183] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/role_assignments?user.id=a0856d72f27148cd8898e10ae2f22155&scope.project.id=f794fab9a99f4cec859475c3705812ef&role.id=a92b62fe43214de0b1468165da0d5456 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.649879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.649879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.649879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.649879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.650913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257eb1-71b1-40f3-b244-6ffb376ced33 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.651382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] RBAC: Adding query filter params (role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=60e78e00233e4cec80710a489bd078ea, user.id=a0856d72f27148cd8898e10ae2f22155) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:14.651592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257eb1-71b1-40f3-b244-6ffb376ced33 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.651750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.652210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257eb1-71b1-40f3-b244-6ffb376ced33 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.657871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.659138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 96/184] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:14.661276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 89/185] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/role_assignments?user.id=a0856d72f27148cd8898e10ae2f22155&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.672511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93b43-3750-4a51-a5cf-4dbee20f3c67 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.673146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93b43-3750-4a51-a5cf-4dbee20f3c67 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.673250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.673832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93b43-3750-4a51-a5cf-4dbee20f3c67 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.675747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 97/186] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:14.677159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c426c8-7b16-4f1e-a736-064e3c65fa4f None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.677634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c426c8-7b16-4f1e-a736-064e3c65fa4f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.678151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c426c8-7b16-4f1e-a736-064e3c65fa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.709375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-81c426c8-7b16-4f1e-a736-064e3c65fa4f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:14.712216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-81c426c8-7b16-4f1e-a736-064e3c65fa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:14.806738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 98/187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:14.807938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902852-a7b4-4dd2-8ca2-8019a5efd46c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.808226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902852-a7b4-4dd2-8ca2-8019a5efd46c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.808504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea902852-a7b4-4dd2-8ca2-8019a5efd46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.865534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ea902852-a7b4-4dd2-8ca2-8019a5efd46c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:14.867377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ea902852-a7b4-4dd2-8ca2-8019a5efd46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:14.886782 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.903630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.912548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff95394-c8b0-4e42-b632-a45b15137ac6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.958030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ea2a-a611-491e-8d7a-a0a235c09312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.958385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 99/188] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:14.959123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea902852-a7b4-4dd2-8ca2-8019a5efd46c None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.959416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ea2a-a611-491e-8d7a-a0a235c09312 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.959897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ea2a-a611-491e-8d7a-a0a235c09312 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.960219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ea2a-a611-491e-8d7a-a0a235c09312 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.975358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0ea2a-a611-491e-8d7a-a0a235c09312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b7f0ea2a-a611-491e-8d7a-a0a235c09312 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:14.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:14.983377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:14.984423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 90/189] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:14.991707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ea2a-a611-491e-8d7a-a0a235c09312 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.078681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea902852-a7b4-4dd2-8ca2-8019a5efd46c None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.120005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b1bd-74c9-4eeb-ae40-4aa2e21921b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.120887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b1bd-74c9-4eeb-ae40-4aa2e21921b9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.121173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b1bd-74c9-4eeb-ae40-4aa2e21921b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.122500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b1bd-74c9-4eeb-ae40-4aa2e21921b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.143241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ea2a-a611-491e-8d7a-a0a235c09312 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.144788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5b1bd-74c9-4eeb-ae40-4aa2e21921b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-d7f5b1bd-74c9-4eeb-ae40-4aa2e21921b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:15.149550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:15.150619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:15.151406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 100/190] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:15.152070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b1bd-74c9-4eeb-ae40-4aa2e21921b9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.166071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.186224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.186848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.187234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.187506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.188170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:15.188465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.192928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.201208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 91/191] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.205936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.226567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.271947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b1bd-74c9-4eeb-ae40-4aa2e21921b9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.308179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5dea0-01ec-48b8-bd37-13d1ce1f3bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.308816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5dea0-01ec-48b8-bd37-13d1ce1f3bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.309129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5dea0-01ec-48b8-bd37-13d1ce1f3bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.309405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5dea0-01ec-48b8-bd37-13d1ce1f3bf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.310542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5dea0-01ec-48b8-bd37-13d1ce1f3bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.315119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0453be-6096-4538-837c-28e673cfe272 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.315568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5dea0-01ec-48b8-bd37-13d1ce1f3bf4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.317314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 101/192] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.318031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5dea0-01ec-48b8-bd37-13d1ce1f3bf4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.350347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.350871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.351153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.351425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.352090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:15.352391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.353759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.362279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 92/193] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.362826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.399460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.423218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5dea0-01ec-48b8-bd37-13d1ce1f3bf4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.443824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.457778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a3ad4-8b1a-4e24-aa87-7b664001d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.458503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a3ad4-8b1a-4e24-aa87-7b664001d2bf None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.458781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a3ad4-8b1a-4e24-aa87-7b664001d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.459060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a3ad4-8b1a-4e24-aa87-7b664001d2bf None admin] PATH_INFO: `/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.463833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7006b-2a99-4745-bcda-99aef1f84b5b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.472254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a3ad4-8b1a-4e24-aa87-7b664001d2bf None admin] RBAC: Authorizing `identity:get_user(user_id=a9b0d1b74d7d4cedbf9cfe9df86f6e55)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.473738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a3ad4-8b1a-4e24-aa87-7b664001d2bf None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.475415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 102/194] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.477814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a3ad4-8b1a-4e24-aa87-7b664001d2bf None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.501061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5236-2f0a-4f60-9106-95abe374fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.501687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5236-2f0a-4f60-9106-95abe374fb29 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.502006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5236-2f0a-4f60-9106-95abe374fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.502282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5236-2f0a-4f60-9106-95abe374fb29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.511929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c5236-2f0a-4f60-9106-95abe374fb29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-243c5236-2f0a-4f60-9106-95abe374fb29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:15.517943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:15.518850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:15.519627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 93/195] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:15.520302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5236-2f0a-4f60-9106-95abe374fb29 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.579661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a3ad4-8b1a-4e24-aa87-7b664001d2bf None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.612963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b464-bad2-4e6c-b11c-1187522dcaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.613500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b464-bad2-4e6c-b11c-1187522dcaec None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.613786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b464-bad2-4e6c-b11c-1187522dcaec None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.614087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34b464-bad2-4e6c-b11c-1187522dcaec None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.614728 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34b464-bad2-4e6c-b11c-1187522dcaec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.616186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34b464-bad2-4e6c-b11c-1187522dcaec None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.618394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5236-2f0a-4f60-9106-95abe374fb29 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.624510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.649869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 103/196] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:15 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:15.649869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b464-bad2-4e6c-b11c-1187522dcaec None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.667918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeb6e6-c00d-49ca-b74a-b890d79e42c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.668671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeb6e6-c00d-49ca-b74a-b890d79e42c2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.668956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeb6e6-c00d-49ca-b74a-b890d79e42c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.669250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeb6e6-c00d-49ca-b74a-b890d79e42c2 None admin] PATH_INFO: `/v3/users/1d69f69eb6de457186837b098c8b50aa` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.670624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeb6e6-c00d-49ca-b74a-b890d79e42c2 None admin] RBAC: Authorizing `identity:get_user(user_id=1d69f69eb6de457186837b098c8b50aa)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.672120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeb6e6-c00d-49ca-b74a-b890d79e42c2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.678462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 94/197] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/users/1d69f69eb6de457186837b098c8b50aa => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.678462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeb6e6-c00d-49ca-b74a-b890d79e42c2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.687660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.766068 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34b464-bad2-4e6c-b11c-1187522dcaec None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.798036 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeb6e6-c00d-49ca-b74a-b890d79e42c2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.804306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2156139-114d-4daf-8ba1-bc2754dff7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.804934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2156139-114d-4daf-8ba1-bc2754dff7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.805220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2156139-114d-4daf-8ba1-bc2754dff7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.805500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2156139-114d-4daf-8ba1-bc2754dff7f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.842909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.843626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.843968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.844240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.845418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:15.845418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.846664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.855381 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 95/198] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.856699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.874837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.890496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2156139-114d-4daf-8ba1-bc2754dff7f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.892315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2156139-114d-4daf-8ba1-bc2754dff7f9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.944456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.979946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa884f3-7217-4fbc-91de-af864a5d484c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.004917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 104/199] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:16.005911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2156139-114d-4daf-8ba1-bc2754dff7f9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.023923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af63132-cd16-4967-96e9-8dee4a1384ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.024831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af63132-cd16-4967-96e9-8dee4a1384ec None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.025113 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af63132-cd16-4967-96e9-8dee4a1384ec None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.025387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af63132-cd16-4967-96e9-8dee4a1384ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.108190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.119447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2156139-114d-4daf-8ba1-bc2754dff7f9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.131341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af63132-cd16-4967-96e9-8dee4a1384ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.133903 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af63132-cd16-4967-96e9-8dee4a1384ec None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.159102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5375ec-5a35-4bba-a18b-2b9d2e88cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.159814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5375ec-5a35-4bba-a18b-2b9d2e88cedd None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.160029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5375ec-5a35-4bba-a18b-2b9d2e88cedd None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.160306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5375ec-5a35-4bba-a18b-2b9d2e88cedd None admin] PATH_INFO: `/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.161455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5375ec-5a35-4bba-a18b-2b9d2e88cedd None admin] RBAC: Authorizing `identity:get_user(user_id=a9b0d1b74d7d4cedbf9cfe9df86f6e55)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.163038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5375ec-5a35-4bba-a18b-2b9d2e88cedd None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.169483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 105/200] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:16.169483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5375ec-5a35-4bba-a18b-2b9d2e88cedd None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.237447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.277113 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 96/201] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:16.278854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af63132-cd16-4967-96e9-8dee4a1384ec None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.299679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5375ec-5a35-4bba-a18b-2b9d2e88cedd None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.338475 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3400036-cfe1-46bf-8edc-53f9ddb1f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.339554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400036-cfe1-46bf-8edc-53f9ddb1f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.340053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400036-cfe1-46bf-8edc-53f9ddb1f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.340600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400036-cfe1-46bf-8edc-53f9ddb1f5a7 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.342317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3400036-cfe1-46bf-8edc-53f9ddb1f5a7 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.344027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3400036-cfe1-46bf-8edc-53f9ddb1f5a7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.346178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 106/202] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:16.347206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3400036-cfe1-46bf-8edc-53f9ddb1f5a7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.377715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.391248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af63132-cd16-4967-96e9-8dee4a1384ec None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.428164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6a4bf-bee6-4105-84da-bd991ec48244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.428797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6a4bf-bee6-4105-84da-bd991ec48244 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.429078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6a4bf-bee6-4105-84da-bd991ec48244 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.429353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6a4bf-bee6-4105-84da-bd991ec48244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.461290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3400036-cfe1-46bf-8edc-53f9ddb1f5a7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.473477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.503175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba7cb-c815-4bd2-97f8-f3c3fff116f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.504166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba7cb-c815-4bd2-97f8-f3c3fff116f9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.504664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba7cb-c815-4bd2-97f8-f3c3fff116f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.505143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba7cb-c815-4bd2-97f8-f3c3fff116f9 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.506659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ba7cb-c815-4bd2-97f8-f3c3fff116f9 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.508294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ba7cb-c815-4bd2-97f8-f3c3fff116f9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.508970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6a4bf-bee6-4105-84da-bd991ec48244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.510394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 107/203] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:16.510642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6a4bf-bee6-4105-84da-bd991ec48244 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.511570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba7cb-c815-4bd2-97f8-f3c3fff116f9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.616332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.624317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba7cb-c815-4bd2-97f8-f3c3fff116f9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.625879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 97/204] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:16.630873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6a4bf-bee6-4105-84da-bd991ec48244 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.662778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.663727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.664208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.664686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.665712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=c6a772c0c77e453aab85badccdb10dc0, user.id=a9b0d1b74d7d4cedbf9cfe9df86f6e55) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:16.666297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.668215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.674581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 108/205] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/role_assignments?user.id=a9b0d1b74d7d4cedbf9cfe9df86f6e55&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=cac8d7ae8325488684667d62304b0860 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:16.675912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.709696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.746463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6a4bf-bee6-4105-84da-bd991ec48244 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.787681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.788294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.788576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.788854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.789586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] RBAC: Adding query filter params (role.id=6e8157956e274229a88aa603c4957f33, scope.project.id=60e78e00233e4cec80710a489bd078ea, user.id=1d69f69eb6de457186837b098c8b50aa) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:16.789923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.791610 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.796256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc67fd5-9781-4578-bcb4-0547f72818a1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.799095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 98/206] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/role_assignments?user.id=1d69f69eb6de457186837b098c8b50aa&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=6e8157956e274229a88aa603c4957f33 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:16.838324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726e060-3226-456a-8020-141c8e4b6c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.839372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e060-3226-456a-8020-141c8e4b6c15 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.839866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e060-3226-456a-8020-141c8e4b6c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.840391 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726e060-3226-456a-8020-141c8e4b6c15 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.842211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726e060-3226-456a-8020-141c8e4b6c15 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.843897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726e060-3226-456a-8020-141c8e4b6c15 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.845803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 109/207] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:16.853893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.989864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd90d1a-8cc7-4380-aeca-c10b705421f8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:17.031515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dc662-57b6-4b17-84fb-6b78d988f194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:17.032132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc662-57b6-4b17-84fb-6b78d988f194 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.032447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc662-57b6-4b17-84fb-6b78d988f194 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.032769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dc662-57b6-4b17-84fb-6b78d988f194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.033518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc662-57b6-4b17-84fb-6b78d988f194 None admin] RBAC: Adding query filter params (role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=c6a772c0c77e453aab85badccdb10dc0, user.id=a9b0d1b74d7d4cedbf9cfe9df86f6e55) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:17.033826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc662-57b6-4b17-84fb-6b78d988f194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:17.035309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dc662-57b6-4b17-84fb-6b78d988f194 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:17.037310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:17.046149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 99/208] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/role_assignments?user.id=a9b0d1b74d7d4cedbf9cfe9df86f6e55&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:17.830754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e3b54-5693-4f87-90b1-9b0e205bb352 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.831786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e3b54-5693-4f87-90b1-9b0e205bb352 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.832297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e3b54-5693-4f87-90b1-9b0e205bb352 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.833878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 110/209] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:17.839217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05f0d-85c9-45ca-8dee-5bbc426ae932 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.839506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05f0d-85c9-45ca-8dee-5bbc426ae932 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.839948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd05f0d-85c9-45ca-8dee-5bbc426ae932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.859283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8dd05f0d-85c9-45ca-8dee-5bbc426ae932 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:17.860483 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8dd05f0d-85c9-45ca-8dee-5bbc426ae932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:17.907895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1d3ee-6723-40bc-8151-d841bc9fe534 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.908180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1d3ee-6723-40bc-8151-d841bc9fe534 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.908462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1d3ee-6723-40bc-8151-d841bc9fe534 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.909824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 111/210] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:17.916702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82992-bc67-4f5f-be99-bb95e4ff6c94 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.916987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82992-bc67-4f5f-be99-bb95e4ff6c94 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.917263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e82992-bc67-4f5f-be99-bb95e4ff6c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.935943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 100/211] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:17.940768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-32e82992-bc67-4f5f-be99-bb95e4ff6c94 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:17.942015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-32e82992-bc67-4f5f-be99-bb95e4ff6c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:17.964039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.017874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 112/212] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:18.220684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd05f0d-85c9-45ca-8dee-5bbc426ae932 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.296195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e82992-bc67-4f5f-be99-bb95e4ff6c94 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.345970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd05f0d-85c9-45ca-8dee-5bbc426ae932 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.375524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.385404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606c007-17e6-4410-a5e0-c2e708ac38fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.386484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c007-17e6-4410-a5e0-c2e708ac38fb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.386484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c007-17e6-4410-a5e0-c2e708ac38fb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.386655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606c007-17e6-4410-a5e0-c2e708ac38fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.388449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606c007-17e6-4410-a5e0-c2e708ac38fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.389944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606c007-17e6-4410-a5e0-c2e708ac38fb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.391911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 101/213] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:18.397310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606c007-17e6-4410-a5e0-c2e708ac38fb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.419996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e82992-bc67-4f5f-be99-bb95e4ff6c94 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.457097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932c683-5850-4c28-bfe0-8f8d47bb2ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.458267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c683-5850-4c28-bfe0-8f8d47bb2ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.458795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c683-5850-4c28-bfe0-8f8d47bb2ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.459371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932c683-5850-4c28-bfe0-8f8d47bb2ef7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.471104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932c683-5850-4c28-bfe0-8f8d47bb2ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-6932c683-5850-4c28-bfe0-8f8d47bb2ef7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:18.476323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:18.477181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:18.478019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:18.489975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 113/214] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:18.492211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932c683-5850-4c28-bfe0-8f8d47bb2ef7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.510583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606c007-17e6-4410-a5e0-c2e708ac38fb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.518716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.550946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3dc0b-2f5f-4686-b691-055f01228cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.551722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3dc0b-2f5f-4686-b691-055f01228cfc None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.552101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3dc0b-2f5f-4686-b691-055f01228cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.552725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3dc0b-2f5f-4686-b691-055f01228cfc None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.553335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3dc0b-2f5f-4686-b691-055f01228cfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.554937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3dc0b-2f5f-4686-b691-055f01228cfc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.588578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 102/215] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:18 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:26:18.625294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932c683-5850-4c28-bfe0-8f8d47bb2ef7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.666370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.667242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.667719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.668125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.669342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:18.669816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.671424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.686243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 114/216] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:18.688465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3dc0b-2f5f-4686-b691-055f01228cfc None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.748949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.799558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3dc0b-2f5f-4686-b691-055f01228cfc None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.835261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fead3a-7bb1-4652-87cb-906bb830ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.835900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fead3a-7bb1-4652-87cb-906bb830ce73 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.836177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fead3a-7bb1-4652-87cb-906bb830ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.836450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fead3a-7bb1-4652-87cb-906bb830ce73 None admin] PATH_INFO: `/v3/users/cb013e627c8f4730901d007ab3449e65` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.852931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fead3a-7bb1-4652-87cb-906bb830ce73 None admin] RBAC: Authorizing `identity:get_user(user_id=cb013e627c8f4730901d007ab3449e65)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.854437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fead3a-7bb1-4652-87cb-906bb830ce73 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.856707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 103/217] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/users/cb013e627c8f4730901d007ab3449e65 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:18.862718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.925769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31a43e-ca53-4b9f-ae12-8c61be86ed09 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.926363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31a43e-ca53-4b9f-ae12-8c61be86ed09 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.926842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31a43e-ca53-4b9f-ae12-8c61be86ed09 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.928413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 104/218] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:18.934783 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6f0b-fd3a-4800-86d9-33d8c797503a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.935355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6f0b-fd3a-4800-86d9-33d8c797503a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.935849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd6f0b-fd3a-4800-86d9-33d8c797503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.962087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-86cd6f0b-fd3a-4800-86d9-33d8c797503a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:18.963296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86cd6f0b-fd3a-4800-86d9-33d8c797503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:18.969367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.003380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a42f0-adc2-4a4b-bb6a-943c50f49d3e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.049037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 105/219] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:19.054581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea98a7-b6c5-4144-a52e-5a0de05ffe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.055213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea98a7-b6c5-4144-a52e-5a0de05ffe18 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.055547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea98a7-b6c5-4144-a52e-5a0de05ffe18 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.055832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea98a7-b6c5-4144-a52e-5a0de05ffe18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.073693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c21da-174f-442e-b34a-b16bc26291fa None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.074011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c21da-174f-442e-b34a-b16bc26291fa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.074295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c21da-174f-442e-b34a-b16bc26291fa None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.075851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 106/220] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:19.080800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0843dc-f654-46a3-8068-ca45d3693e30 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.081085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0843dc-f654-46a3-8068-ca45d3693e30 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.081360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0843dc-f654-46a3-8068-ca45d3693e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.109689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bc0843dc-f654-46a3-8068-ca45d3693e30 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:19.110919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bc0843dc-f654-46a3-8068-ca45d3693e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:19.171413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea98a7-b6c5-4144-a52e-5a0de05ffe18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.172910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea98a7-b6c5-4144-a52e-5a0de05ffe18 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.220183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.266247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.298626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 115/221] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:26:19.305615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea98a7-b6c5-4144-a52e-5a0de05ffe18 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.307908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 107/222] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:19.401687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0843dc-f654-46a3-8068-ca45d3693e30 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.422291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea98a7-b6c5-4144-a52e-5a0de05ffe18 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.460560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bea89-6c89-48cc-a496-97d4aa361d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.461254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bea89-6c89-48cc-a496-97d4aa361d3c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.461757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bea89-6c89-48cc-a496-97d4aa361d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.462113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bea89-6c89-48cc-a496-97d4aa361d3c None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.463451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bea89-6c89-48cc-a496-97d4aa361d3c None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.465334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bea89-6c89-48cc-a496-97d4aa361d3c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.467479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 116/223] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:19.473395 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bea89-6c89-48cc-a496-97d4aa361d3c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.538214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.599531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0843dc-f654-46a3-8068-ca45d3693e30 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.634680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bea89-6c89-48cc-a496-97d4aa361d3c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.670497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3170-7ca0-4eb8-8a4f-efd9d866bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.671131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3170-7ca0-4eb8-8a4f-efd9d866bb83 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.671413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3170-7ca0-4eb8-8a4f-efd9d866bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.671687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a3170-7ca0-4eb8-8a4f-efd9d866bb83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.690829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a3170-7ca0-4eb8-8a4f-efd9d866bb83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-579a3170-7ca0-4eb8-8a4f-efd9d866bb83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:19.696960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:19.697812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:19.698639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:19.699247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 108/224] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:19.703254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.703877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.704160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.704431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.705165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] RBAC: Adding query filter params (role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=c6a772c0c77e453aab85badccdb10dc0, user.id=cb013e627c8f4730901d007ab3449e65) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:19.705473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.706977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.708117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3170-7ca0-4eb8-8a4f-efd9d866bb83 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.713467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 117/225] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/role_assignments?user.id=cb013e627c8f4730901d007ab3449e65&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=a92b62fe43214de0b1468165da0d5456 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:19.718503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.742447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.854863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c662e-70b6-444e-9a11-3a7e34ede292 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.858648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a3170-7ca0-4eb8-8a4f-efd9d866bb83 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.878229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.905624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b98d7-46c6-4faf-944a-26adccbf6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.906308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b98d7-46c6-4faf-944a-26adccbf6bfe None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.906591 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b98d7-46c6-4faf-944a-26adccbf6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.906862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b98d7-46c6-4faf-944a-26adccbf6bfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.923054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.923667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.923945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.924216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.924890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:19.925192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.926548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b98d7-46c6-4faf-944a-26adccbf6bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:19.926657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-930b98d7-46c6-4faf-944a-26adccbf6bfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:19.933349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:19.934819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:19.935625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:19.937036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 118/226] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:19.943478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 109/227] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:19.943624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b98d7-46c6-4faf-944a-26adccbf6bfe None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.949348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.093489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:20.112342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe6642-7949-4da2-9021-72f0ca60bed6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.133634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b98d7-46c6-4faf-944a-26adccbf6bfe None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.179924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aef1b9-659c-46b3-a557-7348ba74b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.180788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aef1b9-659c-46b3-a557-7348ba74b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.181070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aef1b9-659c-46b3-a557-7348ba74b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.181342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aef1b9-659c-46b3-a557-7348ba74b0b4 None admin] PATH_INFO: `/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.183085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aef1b9-659c-46b3-a557-7348ba74b0b4 None admin] RBAC: Authorizing `identity:get_user(user_id=a9b0d1b74d7d4cedbf9cfe9df86f6e55)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.184883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aef1b9-659c-46b3-a557-7348ba74b0b4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.186519 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 110/228] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:20.193647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aef1b9-659c-46b3-a557-7348ba74b0b4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.203770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.204438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.204715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.206828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.207570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:20.207879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.210859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.231399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 119/229] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:20.234856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.330284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:20.354676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61736-f43e-4f62-b4f0-56219bd08846 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.417828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aef1b9-659c-46b3-a557-7348ba74b0b4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.422195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30b789-ef13-4423-b2b8-474a52e4f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.422884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30b789-ef13-4423-b2b8-474a52e4f393 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.423174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30b789-ef13-4423-b2b8-474a52e4f393 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.423451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30b789-ef13-4423-b2b8-474a52e4f393 None admin] PATH_INFO: `/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.428694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30b789-ef13-4423-b2b8-474a52e4f393 None admin] RBAC: Authorizing `identity:get_user(user_id=a9b0d1b74d7d4cedbf9cfe9df86f6e55)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.430216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30b789-ef13-4423-b2b8-474a52e4f393 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.431876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 120/230] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:20 2022] GET /identity/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:20.437242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30b789-ef13-4423-b2b8-474a52e4f393 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.484525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a7211-d8dd-4267-9238-94db3615bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.485163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7211-d8dd-4267-9238-94db3615bc28 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.485449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7211-d8dd-4267-9238-94db3615bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.485725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7211-d8dd-4267-9238-94db3615bc28 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.488164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a7211-d8dd-4267-9238-94db3615bc28 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.491074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a7211-d8dd-4267-9238-94db3615bc28 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.492953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 111/231] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:20 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:20.499747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a7211-d8dd-4267-9238-94db3615bc28 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.552091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:20.615468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30b789-ef13-4423-b2b8-474a52e4f393 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.622320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:20.676717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a7211-d8dd-4267-9238-94db3615bc28 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.686990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3341a0-b610-4788-a88d-a41c0e6782a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.687637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3341a0-b610-4788-a88d-a41c0e6782a0 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.687921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3341a0-b610-4788-a88d-a41c0e6782a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.688200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3341a0-b610-4788-a88d-a41c0e6782a0 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.689457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3341a0-b610-4788-a88d-a41c0e6782a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.691025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3341a0-b610-4788-a88d-a41c0e6782a0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.693883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 121/232] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:20 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:20.698128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3341a0-b610-4788-a88d-a41c0e6782a0 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.740404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedf818-6e77-4c5b-be73-c767bc0a475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.741075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf818-6e77-4c5b-be73-c767bc0a475b None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.741356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf818-6e77-4c5b-be73-c767bc0a475b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.741633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf818-6e77-4c5b-be73-c767bc0a475b None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.749346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedf818-6e77-4c5b-be73-c767bc0a475b None admin] RBAC: Authorizing `identity:create_grant(project_id=c6a772c0c77e453aab85badccdb10dc0, user_id=a9b0d1b74d7d4cedbf9cfe9df86f6e55, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.751075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedf818-6e77-4c5b-be73-c767bc0a475b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.774055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 112/233] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:20 2022] PUT /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:20.826440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3341a0-b610-4788-a88d-a41c0e6782a0 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.891741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41286ecf-bc45-4d35-8127-a33313af2c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.892399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41286ecf-bc45-4d35-8127-a33313af2c41 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.892633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41286ecf-bc45-4d35-8127-a33313af2c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.892900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41286ecf-bc45-4d35-8127-a33313af2c41 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55/roles/2e0116277dbb4c08a7ca7e300f7faa53` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.895160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41286ecf-bc45-4d35-8127-a33313af2c41 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6a772c0c77e453aab85badccdb10dc0, user_id=a9b0d1b74d7d4cedbf9cfe9df86f6e55, role_id=2e0116277dbb4c08a7ca7e300f7faa53)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.896671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41286ecf-bc45-4d35-8127-a33313af2c41 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.935082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 122/234] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:20 2022] PUT /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55/roles/2e0116277dbb4c08a7ca7e300f7faa53 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:21.039778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30cb2-0a5c-4ad1-85d5-21d6f5b99706 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.040457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30cb2-0a5c-4ad1-85d5-21d6f5b99706 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.040943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30cb2-0a5c-4ad1-85d5-21d6f5b99706 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.042551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 113/235] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:21.050179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156d00-87fb-4498-b62c-a6bc6c6b4de5 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.050508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156d00-87fb-4498-b62c-a6bc6c6b4de5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.050748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a156d00-87fb-4498-b62c-a6bc6c6b4de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.076231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-1a156d00-87fb-4498-b62c-a6bc6c6b4de5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:21.077457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1a156d00-87fb-4498-b62c-a6bc6c6b4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:21.102647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080a2a-e3f8-44c0-88c3-5a6cbc395579 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.103425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080a2a-e3f8-44c0-88c3-5a6cbc395579 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.103914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080a2a-e3f8-44c0-88c3-5a6cbc395579 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.106682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 114/236] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:21.113214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:21.115920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7286f-1790-40cd-b5d7-2ced7c291556 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.116533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7286f-1790-40cd-b5d7-2ced7c291556 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.117207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7286f-1790-40cd-b5d7-2ced7c291556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.143777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aed7286f-1790-40cd-b5d7-2ced7c291556 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:21.145376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aed7286f-1790-40cd-b5d7-2ced7c291556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:21.206041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 123/237] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:21.234930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 115/238] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:21.574268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a156d00-87fb-4498-b62c-a6bc6c6b4de5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:21.662662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7286f-1790-40cd-b5d7-2ced7c291556 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:21.705760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:21.747709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a156d00-87fb-4498-b62c-a6bc6c6b4de5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:21.833401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7286f-1790-40cd-b5d7-2ced7c291556 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:21.839256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e4229-15fa-4cc3-b16c-fc6b4ffb9674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:21.839925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e4229-15fa-4cc3-b16c-fc6b4ffb9674 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.840245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e4229-15fa-4cc3-b16c-fc6b4ffb9674 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.840519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e4229-15fa-4cc3-b16c-fc6b4ffb9674 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.843420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e4229-15fa-4cc3-b16c-fc6b4ffb9674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:21.844914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e4229-15fa-4cc3-b16c-fc6b4ffb9674 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:21.846882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 124/239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:21.852269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e4229-15fa-4cc3-b16c-fc6b4ffb9674 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:21.874130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f69d2-9a81-47ad-8270-7a2d4fe8ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:21.875148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f69d2-9a81-47ad-8270-7a2d4fe8ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.875695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f69d2-9a81-47ad-8270-7a2d4fe8ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.876190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f69d2-9a81-47ad-8270-7a2d4fe8ecb5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.888303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f69d2-9a81-47ad-8270-7a2d4fe8ecb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-771f69d2-9a81-47ad-8270-7a2d4fe8ecb5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:21.893577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:21.894498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:21.895287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:21.897624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 116/240] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:21.902233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:21.905754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f69d2-9a81-47ad-8270-7a2d4fe8ecb5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.017301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.055939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f69d2-9a81-47ad-8270-7a2d4fe8ecb5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.077945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e4229-15fa-4cc3-b16c-fc6b4ffb9674 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.140312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.141283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.141743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.142237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.143335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:22.143820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:22.145739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:22.146807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a963-a460-4a73-87e9-7a09b91dff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.147962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a963-a460-4a73-87e9-7a09b91dff94 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.148445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a963-a460-4a73-87e9-7a09b91dff94 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.148911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a963-a460-4a73-87e9-7a09b91dff94 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.149760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243a963-a460-4a73-87e9-7a09b91dff94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:22.151464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243a963-a460-4a73-87e9-7a09b91dff94 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:22.171848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 117/241] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:22.178122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 125/242] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:21 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:26:22.189705 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.311100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f498-9743-4bb9-8420-a2367bd0e0f7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.358788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a360be8-fc88-48f0-9ab3-1ca5c0bc9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.359953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a360be8-fc88-48f0-9ab3-1ca5c0bc9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.360949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a360be8-fc88-48f0-9ab3-1ca5c0bc9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.362159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a360be8-fc88-48f0-9ab3-1ca5c0bc9ab5 None admin] PATH_INFO: `/v3/users/6660bc5f16ba4276a9943fe3ad695fb5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.378066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.383049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a360be8-fc88-48f0-9ab3-1ca5c0bc9ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=6660bc5f16ba4276a9943fe3ad695fb5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:22.384870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a360be8-fc88-48f0-9ab3-1ca5c0bc9ab5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:22.386928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 118/243] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/users/6660bc5f16ba4276a9943fe3ad695fb5 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:22.395142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a963-a460-4a73-87e9-7a09b91dff94 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.431975 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bda6d8-085e-431f-ad65-ed4aa28dc1cf None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.432276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bda6d8-085e-431f-ad65-ed4aa28dc1cf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.432538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bda6d8-085e-431f-ad65-ed4aa28dc1cf None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.434113 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 119/244] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:22.439062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30a9a-0a83-40b6-81a5-f5d51fc5dc98 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.439349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30a9a-0a83-40b6-81a5-f5d51fc5dc98 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.439630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30a9a-0a83-40b6-81a5-f5d51fc5dc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.459263 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0ff30a9a-0a83-40b6-81a5-f5d51fc5dc98 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:22.460557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ff30a9a-0a83-40b6-81a5-f5d51fc5dc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:22.522205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.535875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a963-a460-4a73-87e9-7a09b91dff94 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.577301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 120/245] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:22.586309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc156-dba1-457a-ba06-4c52a8adf03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.586977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc156-dba1-457a-ba06-4c52a8adf03a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.587272 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc156-dba1-457a-ba06-4c52a8adf03a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.587545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccc156-dba1-457a-ba06-4c52a8adf03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.673687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc156-dba1-457a-ba06-4c52a8adf03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:22.675951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccc156-dba1-457a-ba06-4c52a8adf03a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:22.763007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.785587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 126/246] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:22.791255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30a9a-0a83-40b6-81a5-f5d51fc5dc98 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.899539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc156-dba1-457a-ba06-4c52a8adf03a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.902727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30a9a-0a83-40b6-81a5-f5d51fc5dc98 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.936423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.945402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493dde9-03f7-4205-bbbd-e460cc632362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.946069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493dde9-03f7-4205-bbbd-e460cc632362 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.946344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493dde9-03f7-4205-bbbd-e460cc632362 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.946715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493dde9-03f7-4205-bbbd-e460cc632362 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.947942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493dde9-03f7-4205-bbbd-e460cc632362 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:22.949595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493dde9-03f7-4205-bbbd-e460cc632362 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:22.951585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 121/247] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:22.957539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493dde9-03f7-4205-bbbd-e460cc632362 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.028533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccc156-dba1-457a-ba06-4c52a8adf03a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.069234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1fd5c-306b-4d72-9b6b-397ddd57592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.070037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fd5c-306b-4d72-9b6b-397ddd57592c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.070324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fd5c-306b-4d72-9b6b-397ddd57592c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.070601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fd5c-306b-4d72-9b6b-397ddd57592c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.078134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493dde9-03f7-4205-bbbd-e460cc632362 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.083084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1fd5c-306b-4d72-9b6b-397ddd57592c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-3bc1fd5c-306b-4d72-9b6b-397ddd57592c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:23.087936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:23.088825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:23.089623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 127/248] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:23.095331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1fd5c-306b-4d72-9b6b-397ddd57592c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.144261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.157882 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.158497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.158775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.159095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.159880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] RBAC: Adding query filter params (role.id=6e8157956e274229a88aa603c4957f33, scope.project.id=c6a772c0c77e453aab85badccdb10dc0, user.id=6660bc5f16ba4276a9943fe3ad695fb5) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:23.160188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.161632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.177100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 122/249] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/role_assignments?user.id=6660bc5f16ba4276a9943fe3ad695fb5&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=6e8157956e274229a88aa603c4957f33 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.207192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1fd5c-306b-4d72-9b6b-397ddd57592c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.247342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.247982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.248264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.248542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.249239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:23.249549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.251135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.260826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 128/250] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:23.267156 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.335062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.384284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbddef-9717-436e-bdf1-b8b41cc7d65c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.425687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef45587-beff-4edd-9026-dcc4cfacc193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.426415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef45587-beff-4edd-9026-dcc4cfacc193 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.426704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef45587-beff-4edd-9026-dcc4cfacc193 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.426981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef45587-beff-4edd-9026-dcc4cfacc193 None admin] PATH_INFO: `/v3/users/cb013e627c8f4730901d007ab3449e65` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.430768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef45587-beff-4edd-9026-dcc4cfacc193 None admin] RBAC: Authorizing `identity:get_user(user_id=cb013e627c8f4730901d007ab3449e65)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.432273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef45587-beff-4edd-9026-dcc4cfacc193 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.434779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 123/251] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/users/cb013e627c8f4730901d007ab3449e65 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.440499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.482767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b196c-6983-41ad-8053-7d61b18c036c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.483070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b196c-6983-41ad-8053-7d61b18c036c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.483261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b196c-6983-41ad-8053-7d61b18c036c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.484632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 124/252] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:23.490626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effe8e-27c5-4637-8521-942490dad6e9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.491051 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effe8e-27c5-4637-8521-942490dad6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.491467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effe8e-27c5-4637-8521-942490dad6e9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.493055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 125/253] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:23.495118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82c1d-70ea-4eee-91f4-82995370cdb6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.495415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82c1d-70ea-4eee-91f4-82995370cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.495697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a82c1d-70ea-4eee-91f4-82995370cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.516595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-20a82c1d-70ea-4eee-91f4-82995370cdb6 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:23.517772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-20a82c1d-70ea-4eee-91f4-82995370cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:23.575258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e27da-cdd0-4093-a277-51db45b6c138 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.578107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.622137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b075b4-dd9e-4d56-b21b-9ab3c579b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.623011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b075b4-dd9e-4d56-b21b-9ab3c579b014 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.623292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b075b4-dd9e-4d56-b21b-9ab3c579b014 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.623623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b075b4-dd9e-4d56-b21b-9ab3c579b014 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.625209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b075b4-dd9e-4d56-b21b-9ab3c579b014 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.627995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b075b4-dd9e-4d56-b21b-9ab3c579b014 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.634003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 126/254] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:23.635414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c43b-9d8c-42a7-b21a-61b8ad06d945 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.635700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c43b-9d8c-42a7-b21a-61b8ad06d945 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.635974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c43b-9d8c-42a7-b21a-61b8ad06d945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.642407 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 129/255] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.643295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b075b4-dd9e-4d56-b21b-9ab3c579b014 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.682494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-04a9c43b-9d8c-42a7-b21a-61b8ad06d945 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:23.683669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-04a9c43b-9d8c-42a7-b21a-61b8ad06d945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:23.790256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.798068 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b075b4-dd9e-4d56-b21b-9ab3c579b014 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.819772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 127/256] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:23.836015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c53764-901b-4019-aa9c-2f5a9212cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.836691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c53764-901b-4019-aa9c-2f5a9212cb27 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.836975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c53764-901b-4019-aa9c-2f5a9212cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.837251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c53764-901b-4019-aa9c-2f5a9212cb27 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0/users/cb013e627c8f4730901d007ab3449e65/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.839525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c53764-901b-4019-aa9c-2f5a9212cb27 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6a772c0c77e453aab85badccdb10dc0, user_id=cb013e627c8f4730901d007ab3449e65, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.841690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c53764-901b-4019-aa9c-2f5a9212cb27 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.855405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 130/257] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:23 2022] PUT /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0/users/cb013e627c8f4730901d007ab3449e65/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:24.129404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c43b-9d8c-42a7-b21a-61b8ad06d945 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.258965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c53764-901b-4019-aa9c-2f5a9212cb27 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.263601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c43b-9d8c-42a7-b21a-61b8ad06d945 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.311160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:24.327497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80bacc-f736-46e2-a575-8e53bcfa2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.328145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80bacc-f736-46e2-a575-8e53bcfa2777 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.328423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80bacc-f736-46e2-a575-8e53bcfa2777 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.328695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80bacc-f736-46e2-a575-8e53bcfa2777 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.366501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80bacc-f736-46e2-a575-8e53bcfa2777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-3b80bacc-f736-46e2-a575-8e53bcfa2777 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:24.371862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:24.372944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:24.373761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 128/258] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:24.382836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80bacc-f736-46e2-a575-8e53bcfa2777 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.422414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c53764-901b-4019-aa9c-2f5a9212cb27 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.491266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52868bf1-fd9c-4b14-8c34-7783db51f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.492024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52868bf1-fd9c-4b14-8c34-7783db51f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.492319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52868bf1-fd9c-4b14-8c34-7783db51f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.492580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52868bf1-fd9c-4b14-8c34-7783db51f0d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.511051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52868bf1-fd9c-4b14-8c34-7783db51f0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-52868bf1-fd9c-4b14-8c34-7783db51f0d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:24.516374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:24.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:24.518073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:24.525261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 131/259] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:24.534823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52868bf1-fd9c-4b14-8c34-7783db51f0d2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.552213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:24.679998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80bacc-f736-46e2-a575-8e53bcfa2777 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.686198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:24.711721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52868bf1-fd9c-4b14-8c34-7783db51f0d2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.738437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.739411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.740078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.740549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.741439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:24.741981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:24.743675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:24.764963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 129/260] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:24.774821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.793704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.796010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.797175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.797684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.798594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:24.799260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:24.802276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:24.819038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 132/261] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:24.825781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.959632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f5780-892d-4e05-95f2-ddfa96fa7594 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.986476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.002164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729283a-956d-414f-98c8-cbc557500e68 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.029191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f2bcd-283e-4697-963e-84e374420d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.029872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2bcd-283e-4697-963e-84e374420d1b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.030261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2bcd-283e-4697-963e-84e374420d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.030541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2bcd-283e-4697-963e-84e374420d1b None admin] PATH_INFO: `/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.031789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f2bcd-283e-4697-963e-84e374420d1b None admin] RBAC: Authorizing `identity:get_user(user_id=a9b0d1b74d7d4cedbf9cfe9df86f6e55)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.033311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f2bcd-283e-4697-963e-84e374420d1b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.035375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 130/262] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:25.040906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f2bcd-283e-4697-963e-84e374420d1b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.077642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1df0-96bf-4609-90ab-e78ff472884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.078306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1df0-96bf-4609-90ab-e78ff472884f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.078588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1df0-96bf-4609-90ab-e78ff472884f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.082972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1df0-96bf-4609-90ab-e78ff472884f None admin] PATH_INFO: `/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.084134 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e1df0-96bf-4609-90ab-e78ff472884f None admin] RBAC: Authorizing `identity:get_user(user_id=a9b0d1b74d7d4cedbf9cfe9df86f6e55)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.085623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e1df0-96bf-4609-90ab-e78ff472884f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.089896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 133/263] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/users/a9b0d1b74d7d4cedbf9cfe9df86f6e55 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:25.095450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1df0-96bf-4609-90ab-e78ff472884f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.148321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.257404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1df0-96bf-4609-90ab-e78ff472884f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.279234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f2bcd-283e-4697-963e-84e374420d1b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.336352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31a19-dee0-43a6-9a65-2ea2f1be7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.337332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31a19-dee0-43a6-9a65-2ea2f1be7c8c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.337818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31a19-dee0-43a6-9a65-2ea2f1be7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.338334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448ec3b-e083-4eb3-8ff7-0164f76a6926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.338780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31a19-dee0-43a6-9a65-2ea2f1be7c8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.338942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448ec3b-e083-4eb3-8ff7-0164f76a6926 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.339218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448ec3b-e083-4eb3-8ff7-0164f76a6926 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.339488 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448ec3b-e083-4eb3-8ff7-0164f76a6926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.430728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.461406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448ec3b-e083-4eb3-8ff7-0164f76a6926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.463139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448ec3b-e083-4eb3-8ff7-0164f76a6926 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.483731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc31a19-dee0-43a6-9a65-2ea2f1be7c8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.485676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc31a19-dee0-43a6-9a65-2ea2f1be7c8c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.509969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.635234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 134/264] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:25.636935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020637-1ec9-471a-a8eb-4c88bb9abfcb None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.637530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020637-1ec9-471a-a8eb-4c88bb9abfcb None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.638226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e020637-1ec9-471a-a8eb-4c88bb9abfcb None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.641579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 135/265] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:25.642551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e020637-1ec9-471a-a8eb-4c88bb9abfcb None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.686010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 131/266] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:25.687370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f489-738d-4fe2-a3e8-e92754ceb5a2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.687660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f489-738d-4fe2-a3e8-e92754ceb5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.687941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f489-738d-4fe2-a3e8-e92754ceb5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.715306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cd76f489-738d-4fe2-a3e8-e92754ceb5a2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:25.716512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cd76f489-738d-4fe2-a3e8-e92754ceb5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:25.785832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 132/267] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:25.786657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f489-738d-4fe2-a3e8-e92754ceb5a2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.804685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.863821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e020637-1ec9-471a-a8eb-4c88bb9abfcb None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.901769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.910832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76f489-738d-4fe2-a3e8-e92754ceb5a2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.921020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecadac-2e84-41f6-b4e7-a56edbb53bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.921661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecadac-2e84-41f6-b4e7-a56edbb53bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.921967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecadac-2e84-41f6-b4e7-a56edbb53bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.922241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecadac-2e84-41f6-b4e7-a56edbb53bd5 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.923369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecadac-2e84-41f6-b4e7-a56edbb53bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.924837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecadac-2e84-41f6-b4e7-a56edbb53bd5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.935328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 136/268] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:25.942034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecadac-2e84-41f6-b4e7-a56edbb53bd5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.961061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3c96-8502-4c92-9a19-6df422f432e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.962456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3c96-8502-4c92-9a19-6df422f432e1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.962934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3c96-8502-4c92-9a19-6df422f432e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.963387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3c96-8502-4c92-9a19-6df422f432e1 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.964728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3c96-8502-4c92-9a19-6df422f432e1 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.966975 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3c96-8502-4c92-9a19-6df422f432e1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.968967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 133/269] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:25.983612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3c96-8502-4c92-9a19-6df422f432e1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:26.066488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:26.091971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3c96-8502-4c92-9a19-6df422f432e1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.127427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecadac-2e84-41f6-b4e7-a56edbb53bd5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.142920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d84454-a198-4059-91ca-94914a61b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.143551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84454-a198-4059-91ca-94914a61b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.143838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84454-a198-4059-91ca-94914a61b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.144108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d84454-a198-4059-91ca-94914a61b9c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.144840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84454-a198-4059-91ca-94914a61b9c8 None admin] RBAC: Adding query filter params (role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=c6a772c0c77e453aab85badccdb10dc0, user.id=a9b0d1b74d7d4cedbf9cfe9df86f6e55) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:26.145146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84454-a198-4059-91ca-94914a61b9c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:26.146742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d84454-a198-4059-91ca-94914a61b9c8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:26.160448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 134/270] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/role_assignments?user.id=a9b0d1b74d7d4cedbf9cfe9df86f6e55&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:26.161820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021939a8-261f-46d6-a314-7c8426b3e3c1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.162126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021939a8-261f-46d6-a314-7c8426b3e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.162496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021939a8-261f-46d6-a314-7c8426b3e3c1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.163843 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 135/271] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:26.170455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae900981-6c93-4017-ba33-84f2573ca09e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.170776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae900981-6c93-4017-ba33-84f2573ca09e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.171009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae900981-6c93-4017-ba33-84f2573ca09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.175342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.176262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.176770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.177243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.178221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=c6a772c0c77e453aab85badccdb10dc0, user.id=a9b0d1b74d7d4cedbf9cfe9df86f6e55) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:26.178757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:26.180532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:26.189312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 137/272] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/role_assignments?user.id=a9b0d1b74d7d4cedbf9cfe9df86f6e55&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=cac8d7ae8325488684667d62304b0860 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:26.207128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ae900981-6c93-4017-ba33-84f2573ca09e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:26.208425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ae900981-6c93-4017-ba33-84f2573ca09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:26.250145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:26.343320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 136/273] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:26.363254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:26.414880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc57fe-14f1-4d67-bb11-6e50d6c130cd None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.415507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc57fe-14f1-4d67-bb11-6e50d6c130cd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.416014 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc57fe-14f1-4d67-bb11-6e50d6c130cd None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.417631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 137/274] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:26.423224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31fe19-26bb-44c5-98b0-80128bf6f0f1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.426034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03512-4450-4437-81a5-28b25247da09 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.426575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03512-4450-4437-81a5-28b25247da09 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.427052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03512-4450-4437-81a5-28b25247da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.447726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-87f03512-4450-4437-81a5-28b25247da09 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:26.449332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-87f03512-4450-4437-81a5-28b25247da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:26.463639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018ee8-1d1e-43b7-bd3c-c198225cc231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.464497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018ee8-1d1e-43b7-bd3c-c198225cc231 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.464787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018ee8-1d1e-43b7-bd3c-c198225cc231 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.465121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018ee8-1d1e-43b7-bd3c-c198225cc231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.478772 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71018ee8-1d1e-43b7-bd3c-c198225cc231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-71018ee8-1d1e-43b7-bd3c-c198225cc231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:26.484427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:26.485328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:26.486470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 138/275] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:26.492360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018ee8-1d1e-43b7-bd3c-c198225cc231 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:26.528490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:26.534830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 138/276] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:26.611378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018ee8-1d1e-43b7-bd3c-c198225cc231 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.626318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:26.647533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c15fa-49dd-4b34-ac5b-175e7458742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.648145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c15fa-49dd-4b34-ac5b-175e7458742b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.648427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c15fa-49dd-4b34-ac5b-175e7458742b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.648700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c15fa-49dd-4b34-ac5b-175e7458742b None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.649378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c15fa-49dd-4b34-ac5b-175e7458742b None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:26.649735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c15fa-49dd-4b34-ac5b-175e7458742b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:26.651213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c15fa-49dd-4b34-ac5b-175e7458742b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:26.660151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 139/277] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:26.665751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f03512-4450-4437-81a5-28b25247da09 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:26.726476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d4d8-d750-433c-ab5f-17873a975a6e None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.726476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d4d8-d750-433c-ab5f-17873a975a6e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.726854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840d4d8-d750-433c-ab5f-17873a975a6e None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.728117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 140/278] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:26.732515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d4d8-d750-433c-ab5f-17873a975a6e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:26.792831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f03512-4450-4437-81a5-28b25247da09 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.829206 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dae1e-4dc9-4fe5-8e32-7841720ff5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.829865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dae1e-4dc9-4fe5-8e32-7841720ff5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.830349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dae1e-4dc9-4fe5-8e32-7841720ff5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.830689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dae1e-4dc9-4fe5-8e32-7841720ff5e5 None admin] PATH_INFO: `/v3/users/b319b43de1f449299e3206f91e3b0e60` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.844719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dae1e-4dc9-4fe5-8e32-7841720ff5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=b319b43de1f449299e3206f91e3b0e60)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:26.846227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dae1e-4dc9-4fe5-8e32-7841720ff5e5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:26.847881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 139/279] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:26 2022] GET /identity/v3/users/b319b43de1f449299e3206f91e3b0e60 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:26.851098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebaea6-1301-4176-8f98-8c91124e40c0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.851377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebaea6-1301-4176-8f98-8c91124e40c0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.851646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebaea6-1301-4176-8f98-8c91124e40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.853151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840d4d8-d750-433c-ab5f-17873a975a6e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.868734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1eebaea6-1301-4176-8f98-8c91124e40c0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:26.869909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1eebaea6-1301-4176-8f98-8c91124e40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:26.887490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc09d-798e-4eaf-8eaf-5aba4fee537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.888111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc09d-798e-4eaf-8eaf-5aba4fee537d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.888392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc09d-798e-4eaf-8eaf-5aba4fee537d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.888663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dc09d-798e-4eaf-8eaf-5aba4fee537d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.898820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3dc09d-798e-4eaf-8eaf-5aba4fee537d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-ad3dc09d-798e-4eaf-8eaf-5aba4fee537d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:26.904332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:26.905438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:26.906403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 141/280] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:26.907059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc09d-798e-4eaf-8eaf-5aba4fee537d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:26.928089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:26.941504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:26.942530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 140/281] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:26.943347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebaea6-1301-4176-8f98-8c91124e40c0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.015798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dc09d-798e-4eaf-8eaf-5aba4fee537d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.040341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebaea6-1301-4176-8f98-8c91124e40c0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.052631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700119c-a2d9-4a84-b1be-51840782aa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.053264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700119c-a2d9-4a84-b1be-51840782aa42 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.053544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700119c-a2d9-4a84-b1be-51840782aa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.053816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700119c-a2d9-4a84-b1be-51840782aa42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.055162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700119c-a2d9-4a84-b1be-51840782aa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.056710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700119c-a2d9-4a84-b1be-51840782aa42 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.059274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 142/282] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.059942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700119c-a2d9-4a84-b1be-51840782aa42 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.082251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.082881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.083589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.083886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.084585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] RBAC: Adding query filter params (role.id=a92b62fe43214de0b1468165da0d5456, user.id=b319b43de1f449299e3206f91e3b0e60, scope.system=all) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:27.084888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.086361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.101868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 141/283] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 26 15:26:26 2022] GET /identity/v3/role_assignments?user.id=b319b43de1f449299e3206f91e3b0e60&scope.system=all&role.id=a92b62fe43214de0b1468165da0d5456 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.101868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.183313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.193799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700119c-a2d9-4a84-b1be-51840782aa42 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.197469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.239309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.240234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.240519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.241048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.241726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:27.242221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.244319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.245469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302f75b-8236-45f4-a0cd-17289184770b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.254452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 143/284] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.255085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.286805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a1a2-991a-4822-936e-a3c1e59b2137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.287696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a1a2-991a-4822-936e-a3c1e59b2137 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.287986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a1a2-991a-4822-936e-a3c1e59b2137 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.288250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723a1a2-991a-4822-936e-a3c1e59b2137 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.288906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723a1a2-991a-4822-936e-a3c1e59b2137 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.290385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723a1a2-991a-4822-936e-a3c1e59b2137 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.322093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 142/285] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:27 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:27.322093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a1a2-991a-4822-936e-a3c1e59b2137 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.389866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527346-2773-40b6-beed-cc81225322c2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.435897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9aff-fffa-43de-9ef2-74ecbbafd1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.436795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9aff-fffa-43de-9ef2-74ecbbafd1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.437078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9aff-fffa-43de-9ef2-74ecbbafd1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.437496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9aff-fffa-43de-9ef2-74ecbbafd1a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.450980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d9aff-fffa-43de-9ef2-74ecbbafd1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-071d9aff-fffa-43de-9ef2-74ecbbafd1a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:27.456426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:27.457572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:27.458524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 144/286] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:27.463501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9aff-fffa-43de-9ef2-74ecbbafd1a9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.483108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723a1a2-991a-4822-936e-a3c1e59b2137 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.494861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.500747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.529211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6a952-79ea-4fee-b9c4-bbfeaf6e14e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.530664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6a952-79ea-4fee-b9c4-bbfeaf6e14e9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.530771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6a952-79ea-4fee-b9c4-bbfeaf6e14e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.531885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6a952-79ea-4fee-b9c4-bbfeaf6e14e9 None admin] PATH_INFO: `/v3/users/6660bc5f16ba4276a9943fe3ad695fb5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.532994 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6a952-79ea-4fee-b9c4-bbfeaf6e14e9 None admin] RBAC: Authorizing `identity:get_user(user_id=6660bc5f16ba4276a9943fe3ad695fb5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.536384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6a952-79ea-4fee-b9c4-bbfeaf6e14e9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.536794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 143/287] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/users/6660bc5f16ba4276a9943fe3ad695fb5 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.543469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6a952-79ea-4fee-b9c4-bbfeaf6e14e9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.585151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9aff-fffa-43de-9ef2-74ecbbafd1a9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.628779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.629391 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.629674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.629993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.630675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:27.630974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.632379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.642352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 145/288] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.647729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.679431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6a952-79ea-4fee-b9c4-bbfeaf6e14e9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.729767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6c847-daa8-4659-b9a5-f801fc2e8324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.731396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6c847-daa8-4659-b9a5-f801fc2e8324 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.731843 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6c847-daa8-4659-b9a5-f801fc2e8324 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.732618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6c847-daa8-4659-b9a5-f801fc2e8324 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.734594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6c847-daa8-4659-b9a5-f801fc2e8324 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.736371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6c847-daa8-4659-b9a5-f801fc2e8324 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.741864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 144/289] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.746033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6c847-daa8-4659-b9a5-f801fc2e8324 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.767736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.782144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83761-fec2-4d32-bf8c-7e3ea66cec1e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.813239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.823918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9675237-4aae-494b-8d73-727c216f96da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.825103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675237-4aae-494b-8d73-727c216f96da None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.825440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675237-4aae-494b-8d73-727c216f96da None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.825719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675237-4aae-494b-8d73-727c216f96da None admin] PATH_INFO: `/v3/users/cb013e627c8f4730901d007ab3449e65` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.826893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9675237-4aae-494b-8d73-727c216f96da None admin] RBAC: Authorizing `identity:get_user(user_id=cb013e627c8f4730901d007ab3449e65)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.828539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9675237-4aae-494b-8d73-727c216f96da None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.830600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 146/290] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/users/cb013e627c8f4730901d007ab3449e65 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.838520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9675237-4aae-494b-8d73-727c216f96da None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.919327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6c847-daa8-4659-b9a5-f801fc2e8324 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.988369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2c313-9643-4537-81e3-e05604de8012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.989101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2c313-9643-4537-81e3-e05604de8012 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.989386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2c313-9643-4537-81e3-e05604de8012 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.989665 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2c313-9643-4537-81e3-e05604de8012 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0/users/6660bc5f16ba4276a9943fe3ad695fb5/roles/6e8157956e274229a88aa603c4957f33` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.991674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2c313-9643-4537-81e3-e05604de8012 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6a772c0c77e453aab85badccdb10dc0, user_id=6660bc5f16ba4276a9943fe3ad695fb5, role_id=6e8157956e274229a88aa603c4957f33)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.993125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2c313-9643-4537-81e3-e05604de8012 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:28.020393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 145/291] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:27 2022] PUT /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0/users/6660bc5f16ba4276a9943fe3ad695fb5/roles/6e8157956e274229a88aa603c4957f33 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:26:28.029941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9675237-4aae-494b-8d73-727c216f96da None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:28.093608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf3a30-e17b-440a-bacd-7d3d9ffae296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:28.094308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3a30-e17b-440a-bacd-7d3d9ffae296 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.094592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3a30-e17b-440a-bacd-7d3d9ffae296 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.094866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3a30-e17b-440a-bacd-7d3d9ffae296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.138651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:28.197779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf3a30-e17b-440a-bacd-7d3d9ffae296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:28.200575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf3a30-e17b-440a-bacd-7d3d9ffae296 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:28.328024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 147/292] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:28.333678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2c313-9643-4537-81e3-e05604de8012 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:28.439778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2c313-9643-4537-81e3-e05604de8012 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:28.442147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:28.486359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31005de5-f9e5-4667-af44-75ad4101172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:28.486921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005de5-f9e5-4667-af44-75ad4101172c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.487205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005de5-f9e5-4667-af44-75ad4101172c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.487479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31005de5-f9e5-4667-af44-75ad4101172c None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.488671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31005de5-f9e5-4667-af44-75ad4101172c None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:28.490141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31005de5-f9e5-4667-af44-75ad4101172c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:28.492075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 146/293] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:28 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:28.498663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf3a30-e17b-440a-bacd-7d3d9ffae296 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:28.562230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:28.601849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf3a30-e17b-440a-bacd-7d3d9ffae296 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:28.638075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeab3b-bf9e-4261-9b09-0b8c35d5a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:28.638677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeab3b-bf9e-4261-9b09-0b8c35d5a3cb None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.638960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeab3b-bf9e-4261-9b09-0b8c35d5a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.639233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeab3b-bf9e-4261-9b09-0b8c35d5a3cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.640012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eeab3b-bf9e-4261-9b09-0b8c35d5a3cb None admin] RBAC: Adding query filter params (role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=c6a772c0c77e453aab85badccdb10dc0, user.id=cb013e627c8f4730901d007ab3449e65) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:28.640325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eeab3b-bf9e-4261-9b09-0b8c35d5a3cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:28.641829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eeab3b-bf9e-4261-9b09-0b8c35d5a3cb None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:28.647926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 148/294] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:28 2022] GET /identity/v3/role_assignments?user.id=cb013e627c8f4730901d007ab3449e65&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=a92b62fe43214de0b1468165da0d5456 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:29.334674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81397df-f217-4e0a-9f03-5e26bfbd1663 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.335260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81397df-f217-4e0a-9f03-5e26bfbd1663 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.335260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81397df-f217-4e0a-9f03-5e26bfbd1663 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.336562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 147/295] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:29.343175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a480-eb3a-428d-9313-6d4c2f63e9d2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.343718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a480-eb3a-428d-9313-6d4c2f63e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.344188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3a480-eb3a-428d-9313-6d4c2f63e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.364022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-26c3a480-eb3a-428d-9313-6d4c2f63e9d2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:29.365542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-26c3a480-eb3a-428d-9313-6d4c2f63e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:29.438871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 149/296] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:29.711729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81397df-f217-4e0a-9f03-5e26bfbd1663 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.754919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee51f4-060b-4d8a-892c-37681cac2a62 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.755874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee51f4-060b-4d8a-892c-37681cac2a62 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.756340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee51f4-060b-4d8a-892c-37681cac2a62 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.758167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 150/297] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:29.764095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3c36-d834-410e-a8d5-3d81a65d2472 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.764648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3c36-d834-410e-a8d5-3d81a65d2472 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.765180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a3c36-d834-410e-a8d5-3d81a65d2472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.784353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-808a3c36-d834-410e-a8d5-3d81a65d2472 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:29.785982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-808a3c36-d834-410e-a8d5-3d81a65d2472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:29.830263 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81397df-f217-4e0a-9f03-5e26bfbd1663 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.838289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:29.861513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 151/298] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:29.867250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2b69-7ab0-4cd9-a586-cf5e36bee0b1 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.867532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2b69-7ab0-4cd9-a586-cf5e36bee0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.867809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef2b69-7ab0-4cd9-a586-cf5e36bee0b1 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.869094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 152/299] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:29.874600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743419ad-2169-4da8-ad49-a2d12e1e8be7 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.874879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743419ad-2169-4da8-ad49-a2d12e1e8be7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.875150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743419ad-2169-4da8-ad49-a2d12e1e8be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.877800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d47f-cfb4-4213-bdf6-aa3121e6a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.878479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d47f-cfb4-4213-bdf6-aa3121e6a803 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.878762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d47f-cfb4-4213-bdf6-aa3121e6a803 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.879035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d47f-cfb4-4213-bdf6-aa3121e6a803 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.890265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62d47f-cfb4-4213-bdf6-aa3121e6a803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:29.893547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-743419ad-2169-4da8-ad49-a2d12e1e8be7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:29.894739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-743419ad-2169-4da8-ad49-a2d12e1e8be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-da62d47f-cfb4-4213-bdf6-aa3121e6a803 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:29.895463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:29.896344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:29.897138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 148/300] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:29.903720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d47f-cfb4-4213-bdf6-aa3121e6a803 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.975832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 153/301] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:29.976394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.034261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d47f-cfb4-4213-bdf6-aa3121e6a803 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.069572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.070504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.070971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.071410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.072267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:30.072737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.074481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.083134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 149/302] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:30.088732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743419ad-2169-4da8-ad49-a2d12e1e8be7 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.156129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.211784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743419ad-2169-4da8-ad49-a2d12e1e8be7 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.227990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.257430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865b33-f300-4a1e-b4d8-1a4a56a250ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.258204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865b33-f300-4a1e-b4d8-1a4a56a250ea None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.258561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865b33-f300-4a1e-b4d8-1a4a56a250ea None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.258904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88865b33-f300-4a1e-b4d8-1a4a56a250ea None admin] PATH_INFO: `/v3/users/b319b43de1f449299e3206f91e3b0e60` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.260279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.260449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88865b33-f300-4a1e-b4d8-1a4a56a250ea None admin] RBAC: Authorizing `identity:get_user(user_id=b319b43de1f449299e3206f91e3b0e60)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.263115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88865b33-f300-4a1e-b4d8-1a4a56a250ea None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.265104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 154/303] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/users/b319b43de1f449299e3206f91e3b0e60 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:30.268413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2157cd-6349-47a9-8742-29fb6c448270 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.271330 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865b33-f300-4a1e-b4d8-1a4a56a250ea None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.305404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8922f6-5d9b-4607-87a4-0b5f72788c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.306059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8922f6-5d9b-4607-87a4-0b5f72788c4c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.306342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8922f6-5d9b-4607-87a4-0b5f72788c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.306615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8922f6-5d9b-4607-87a4-0b5f72788c4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.318966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8922f6-5d9b-4607-87a4-0b5f72788c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4b8922f6-5d9b-4607-87a4-0b5f72788c4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:30.324177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:30.325312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:30.326241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 150/304] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:30.326906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8922f6-5d9b-4607-87a4-0b5f72788c4c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.374008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88865b33-f300-4a1e-b4d8-1a4a56a250ea None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.410417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28780851-d6bd-4d7f-8c56-ff88d2e71d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.411080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28780851-d6bd-4d7f-8c56-ff88d2e71d46 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.411362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28780851-d6bd-4d7f-8c56-ff88d2e71d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.411636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28780851-d6bd-4d7f-8c56-ff88d2e71d46 None admin] PATH_INFO: `/v3/system/users/b319b43de1f449299e3206f91e3b0e60/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.413040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28780851-d6bd-4d7f-8c56-ff88d2e71d46 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b319b43de1f449299e3206f91e3b0e60, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.414513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28780851-d6bd-4d7f-8c56-ff88d2e71d46 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.423821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 155/305] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Aug 26 15:26:30 2022] PUT /identity/v3/system/users/b319b43de1f449299e3206f91e3b0e60/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:30.425120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3899e-5715-4974-a5b7-8d69b0561049 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.425414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3899e-5715-4974-a5b7-8d69b0561049 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.425691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3899e-5715-4974-a5b7-8d69b0561049 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.429908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 156/306] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:30.429908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3899e-5715-4974-a5b7-8d69b0561049 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.438806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8922f6-5d9b-4607-87a4-0b5f72788c4c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.477557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59cd38-72d8-4093-866b-52f26c07fab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.478296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cd38-72d8-4093-866b-52f26c07fab9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.478529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cd38-72d8-4093-866b-52f26c07fab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.478801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cd38-72d8-4093-866b-52f26c07fab9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.480016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cd38-72d8-4093-866b-52f26c07fab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.482167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cd38-72d8-4093-866b-52f26c07fab9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.484088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 151/307] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:30.485064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9cdd6-2102-4c7f-be70-f1e7a7763179 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.485363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9cdd6-2102-4c7f-be70-f1e7a7763179 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.485618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9cdd6-2102-4c7f-be70-f1e7a7763179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.494419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.505105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c8b9cdd6-2102-4c7f-be70-f1e7a7763179 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:30.506384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c8b9cdd6-2102-4c7f-be70-f1e7a7763179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:30.524570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.568459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3899e-5715-4974-a5b7-8d69b0561049 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.580045 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 152/308] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:30.580213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9cdd6-2102-4c7f-be70-f1e7a7763179 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.609461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.610207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.610606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.610882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.612099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] RBAC: Adding query filter params (name=reader) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:30.612409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.613795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.623882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 157/309] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:30.629469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.701025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9cdd6-2102-4c7f-be70-f1e7a7763179 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.738867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e915-4ef8-48d8-b604-a44afdef3248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.739346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e915-4ef8-48d8-b604-a44afdef3248 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.739807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e915-4ef8-48d8-b604-a44afdef3248 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.740091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e915-4ef8-48d8-b604-a44afdef3248 None admin] PATH_INFO: `/v3/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.740720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99e915-4ef8-48d8-b604-a44afdef3248 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.742224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99e915-4ef8-48d8-b604-a44afdef3248 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.763133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 153/310] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Aug 26 15:26:30 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:30.764641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693d0ce-6eac-457c-8bc4-6fd002893bef None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.768156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.817704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4730b-9453-423e-bb66-668d2774e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.818722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4730b-9453-423e-bb66-668d2774e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.819218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4730b-9453-423e-bb66-668d2774e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.819685 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4730b-9453-423e-bb66-668d2774e2f1 None admin] PATH_INFO: `/v3/users/b6df61c5152a47ddab681e121d91d903` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.837204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4730b-9453-423e-bb66-668d2774e2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=b6df61c5152a47ddab681e121d91d903)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.838923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4730b-9453-423e-bb66-668d2774e2f1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.842349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 158/311] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/users/b6df61c5152a47ddab681e121d91d903 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:30.848985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e915-4ef8-48d8-b604-a44afdef3248 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.852820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4730b-9453-423e-bb66-668d2774e2f1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.867451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.981155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e915-4ef8-48d8-b604-a44afdef3248 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.983192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4730b-9453-423e-bb66-668d2774e2f1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:31.026652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6f95a-a980-42c0-93b0-d61aa96c1eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:31.027797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6f95a-a980-42c0-93b0-d61aa96c1eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.028312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6f95a-a980-42c0-93b0-d61aa96c1eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.028556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:31.029029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6f95a-a980-42c0-93b0-d61aa96c1eb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.029149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.029434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.029707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.030644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] RBAC: Adding query filter params (role.id=6e8157956e274229a88aa603c4957f33, user.id=b6df61c5152a47ddab681e121d91d903, scope.system=all) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:31.030955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:31.032411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:31.038108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 154/312] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/role_assignments?user.id=b6df61c5152a47ddab681e121d91d903&scope.system=all&role.id=6e8157956e274229a88aa603c4957f33 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:31.042558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6f95a-a980-42c0-93b0-d61aa96c1eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-82f6f95a-a980-42c0-93b0-d61aa96c1eb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:31.050203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:31.054180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:31.054978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 159/313] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:31.056801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:31.148419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:31.175257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb0810-df44-40f1-9411-b1199daeac76 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:31.213037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:31.213788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.214261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.214633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.215463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:31.215876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:31.218729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:31.228133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 155/314] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:31.233584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6f95a-a980-42c0-93b0-d61aa96c1eb4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:31.259797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:31.343710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6f95a-a980-42c0-93b0-d61aa96c1eb4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:31.383048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b68f-d8c6-4632-a14a-2a79fb1ec710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:31.383931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b68f-d8c6-4632-a14a-2a79fb1ec710 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.384383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b68f-d8c6-4632-a14a-2a79fb1ec710 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.384800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b68f-d8c6-4632-a14a-2a79fb1ec710 None admin] PATH_INFO: `/v3/users/6660bc5f16ba4276a9943fe3ad695fb5` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.386129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b68f-d8c6-4632-a14a-2a79fb1ec710 None admin] RBAC: Authorizing `identity:get_user(user_id=6660bc5f16ba4276a9943fe3ad695fb5)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:31.388304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b68f-d8c6-4632-a14a-2a79fb1ec710 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:31.390402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 160/315] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:31 2022] GET /identity/v3/users/6660bc5f16ba4276a9943fe3ad695fb5 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:31.395726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:31.506975 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54409-4f33-4487-876c-1ebc49a46c9e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:31.544223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4ffd7-deda-43b6-9ca8-4bca12079fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:31.545215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ffd7-deda-43b6-9ca8-4bca12079fbb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.545715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ffd7-deda-43b6-9ca8-4bca12079fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.546270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ffd7-deda-43b6-9ca8-4bca12079fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.556063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:31.626330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4ffd7-deda-43b6-9ca8-4bca12079fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:31.627720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4ffd7-deda-43b6-9ca8-4bca12079fbb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:31.728193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:31.734312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b68f-d8c6-4632-a14a-2a79fb1ec710 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:31.829404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:31.841658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b68f-d8c6-4632-a14a-2a79fb1ec710 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:31.878516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c6195-fe33-4e59-bde1-85719a03378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:31.879070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6195-fe33-4e59-bde1-85719a03378c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.879356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6195-fe33-4e59-bde1-85719a03378c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.879636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6195-fe33-4e59-bde1-85719a03378c None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.880760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c6195-fe33-4e59-bde1-85719a03378c None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:31.882264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c6195-fe33-4e59-bde1-85719a03378c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:31.884254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 161/317] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:31 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:31.890948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4ffd7-deda-43b6-9ca8-4bca12079fbb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:31.931858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:32.004835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4ffd7-deda-43b6-9ca8-4bca12079fbb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:32.040110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d1fd-3532-444c-b8c6-6341a0850e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:32.041094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d1fd-3532-444c-b8c6-6341a0850e6a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.041575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d1fd-3532-444c-b8c6-6341a0850e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.042109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d1fd-3532-444c-b8c6-6341a0850e6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.043105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d1fd-3532-444c-b8c6-6341a0850e6a None admin] RBAC: Adding query filter params (role.id=6e8157956e274229a88aa603c4957f33, scope.project.id=c6a772c0c77e453aab85badccdb10dc0, user.id=6660bc5f16ba4276a9943fe3ad695fb5) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:32.043650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d1fd-3532-444c-b8c6-6341a0850e6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:32.045347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d1fd-3532-444c-b8c6-6341a0850e6a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:32.053463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 157/318] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:31 2022] GET /identity/v3/role_assignments?user.id=6660bc5f16ba4276a9943fe3ad695fb5&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=6e8157956e274229a88aa603c4957f33 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:32.445420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be4fb-cc10-48fa-9b97-eb48ba3153db None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.445802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be4fb-cc10-48fa-9b97-eb48ba3153db None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.446026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be4fb-cc10-48fa-9b97-eb48ba3153db None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.447375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 162/319] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:32.452824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f98b-4f14-46d7-ab53-6a57160c7147 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.453110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f98b-4f14-46d7-ab53-6a57160c7147 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.453384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f98b-4f14-46d7-ab53-6a57160c7147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.471228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2259f98b-4f14-46d7-ab53-6a57160c7147 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:32.472406 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2259f98b-4f14-46d7-ab53-6a57160c7147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:32.544114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 158/320] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:32.811792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88be4fb-cc10-48fa-9b97-eb48ba3153db None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:32.911068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aeba5-b9b0-4af6-9f22-cf0647dd92c4 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.911339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aeba5-b9b0-4af6-9f22-cf0647dd92c4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.911607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aeba5-b9b0-4af6-9f22-cf0647dd92c4 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.913089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 159/321] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:32.915527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88be4fb-cc10-48fa-9b97-eb48ba3153db None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:32.918070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460661ac-5a5c-47b9-b9a6-6da9d759ece0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.918492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460661ac-5a5c-47b9-b9a6-6da9d759ece0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.918775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460661ac-5a5c-47b9-b9a6-6da9d759ece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.940886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-460661ac-5a5c-47b9-b9a6-6da9d759ece0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:32.942751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-460661ac-5a5c-47b9-b9a6-6da9d759ece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:32.953669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aec0e3-6077-4679-ab35-d13a10d33d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:32.954333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aec0e3-6077-4679-ab35-d13a10d33d0c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.954616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aec0e3-6077-4679-ab35-d13a10d33d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.954890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aec0e3-6077-4679-ab35-d13a10d33d0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.966335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aec0e3-6077-4679-ab35-d13a10d33d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-30aec0e3-6077-4679-ab35-d13a10d33d0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:32.971469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:32.972545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:32.974632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 163/322] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:32.978288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aec0e3-6077-4679-ab35-d13a10d33d0c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:32.980140 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:32.999699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:33.033887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 160/323] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:33.091036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aec0e3-6077-4679-ab35-d13a10d33d0c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.096794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6402cdc-d248-4b49-b0a8-50e19b924a73 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.097085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6402cdc-d248-4b49-b0a8-50e19b924a73 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.097362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6402cdc-d248-4b49-b0a8-50e19b924a73 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.102313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 161/324] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:33.105044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce72f-5009-4ce3-8fd6-067f46192a04 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.105475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce72f-5009-4ce3-8fd6-067f46192a04 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.105872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce72f-5009-4ce3-8fd6-067f46192a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.129771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-50cce72f-5009-4ce3-8fd6-067f46192a04 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:33.131579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-50cce72f-5009-4ce3-8fd6-067f46192a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:33.135457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.137580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.137580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.137580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.138098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:33.138412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.139906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.153249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 164/325] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:33.158438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.216346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 162/326] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:33.245555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:33.266911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527721a-d0e1-4618-9b45-27004cf6a4c7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.301088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223998b-4a77-4aec-836e-8ac6349959f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.301714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223998b-4a77-4aec-836e-8ac6349959f0 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.302028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223998b-4a77-4aec-836e-8ac6349959f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.302299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223998b-4a77-4aec-836e-8ac6349959f0 None admin] PATH_INFO: `/v3/users/b319b43de1f449299e3206f91e3b0e60` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.303401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223998b-4a77-4aec-836e-8ac6349959f0 None admin] RBAC: Authorizing `identity:get_user(user_id=b319b43de1f449299e3206f91e3b0e60)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.304836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223998b-4a77-4aec-836e-8ac6349959f0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.306605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 165/327] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:33 2022] GET /identity/v3/users/b319b43de1f449299e3206f91e3b0e60 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:33.312565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce72f-5009-4ce3-8fd6-067f46192a04 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.318054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223998b-4a77-4aec-836e-8ac6349959f0 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.416321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:33.426569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce72f-5009-4ce3-8fd6-067f46192a04 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.427796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223998b-4a77-4aec-836e-8ac6349959f0 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.471511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecca3-9c1e-4302-8782-5e40927ee60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.472149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecca3-9c1e-4302-8782-5e40927ee60c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.472427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecca3-9c1e-4302-8782-5e40927ee60c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.472699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ecca3-9c1e-4302-8782-5e40927ee60c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.473787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ecca3-9c1e-4302-8782-5e40927ee60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.474666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.475299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ecca3-9c1e-4302-8782-5e40927ee60c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.475707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.476208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.477651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.477759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 166/328] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:33.478359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] RBAC: Adding query filter params (role.id=a92b62fe43214de0b1468165da0d5456, user.id=b319b43de1f449299e3206f91e3b0e60, scope.system=all) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:33.478673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.480335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.482844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecca3-9c1e-4302-8782-5e40927ee60c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.498932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 163/329] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 26 15:26:33 2022] GET /identity/v3/role_assignments?user.id=b319b43de1f449299e3206f91e3b0e60&scope.system=all&role.id=a92b62fe43214de0b1468165da0d5456 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:33.507532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:33.510641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.606371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ecca3-9c1e-4302-8782-5e40927ee60c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.642415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47971851-fdbd-4fce-8dcf-ab5aa508beb4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.647382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf39f51-3427-47e6-98ec-cc65297341ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.647760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf39f51-3427-47e6-98ec-cc65297341ff None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.648398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf39f51-3427-47e6-98ec-cc65297341ff None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.648398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf39f51-3427-47e6-98ec-cc65297341ff None admin] PATH_INFO: `/v3/groups` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.648922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf39f51-3427-47e6-98ec-cc65297341ff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.650432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf39f51-3427-47e6-98ec-cc65297341ff None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.672665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 167/330] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Aug 26 15:26:33 2022] POST /identity/v3/groups => generated 226 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:26:33.690346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0d318-2316-44ff-9e6a-650a63f11b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.691244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d318-2316-44ff-9e6a-650a63f11b99 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.691668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d318-2316-44ff-9e6a-650a63f11b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.692120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d318-2316-44ff-9e6a-650a63f11b99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.706532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0d318-2316-44ff-9e6a-650a63f11b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-cdd0d318-2316-44ff-9e6a-650a63f11b99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:33.712318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:33.713295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:33.714161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:33.717923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 164/331] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:33.721861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf39f51-3427-47e6-98ec-cc65297341ff None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.820964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:33.857796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf39f51-3427-47e6-98ec-cc65297341ff None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.897929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.898547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.898826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.899097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.899760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:33.900059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.901423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.912541 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 168/332] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:33.918285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0d318-2316-44ff-9e6a-650a63f11b99 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.932333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:34.025900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0d318-2316-44ff-9e6a-650a63f11b99 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:34.062544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4cc14-e41b-4b45-a745-465cbab51abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:34.063187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4cc14-e41b-4b45-a745-465cbab51abf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:34.063470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4cc14-e41b-4b45-a745-465cbab51abf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:34.063747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4cc14-e41b-4b45-a745-465cbab51abf None admin] PATH_INFO: `/v3/users/b6df61c5152a47ddab681e121d91d903` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:34.064906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4cc14-e41b-4b45-a745-465cbab51abf None admin] RBAC: Authorizing `identity:get_user(user_id=b6df61c5152a47ddab681e121d91d903)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:34.066425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4cc14-e41b-4b45-a745-465cbab51abf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:34.068275 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 165/333] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:33 2022] GET /identity/v3/users/b6df61c5152a47ddab681e121d91d903 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:34.073660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:34.185014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce2b94-2793-4044-b8dc-673df49d0c1f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:34.231657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96143f-0811-45f7-bd62-a7e308538132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:34.232719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96143f-0811-45f7-bd62-a7e308538132 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:34.233204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96143f-0811-45f7-bd62-a7e308538132 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:34.233717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96143f-0811-45f7-bd62-a7e308538132 None admin] PATH_INFO: `/v3/system/users/b6df61c5152a47ddab681e121d91d903/roles/6e8157956e274229a88aa603c4957f33` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:34.235475 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96143f-0811-45f7-bd62-a7e308538132 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b6df61c5152a47ddab681e121d91d903, role_id=6e8157956e274229a88aa603c4957f33)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:34.237373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96143f-0811-45f7-bd62-a7e308538132 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:34.246952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 169/334] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Aug 26 15:26:34 2022] PUT /identity/v3/system/users/b6df61c5152a47ddab681e121d91d903/roles/6e8157956e274229a88aa603c4957f33 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:36.123412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b921-8265-41ff-8898-b1bb4bbd6c27 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.123956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b921-8265-41ff-8898-b1bb4bbd6c27 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.123956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b921-8265-41ff-8898-b1bb4bbd6c27 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.125608 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 166/335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:36.131351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77c1b-0a89-4b4c-bb15-0b449b1c85a2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.131793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77c1b-0a89-4b4c-bb15-0b449b1c85a2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.131968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77c1b-0a89-4b4c-bb15-0b449b1c85a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.141499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.154884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-99f77c1b-0a89-4b4c-bb15-0b449b1c85a2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:36.156316 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-99f77c1b-0a89-4b4c-bb15-0b449b1c85a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:36.253995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 170/336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:36.274672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c490b-56dd-4b56-a4a7-f854653337ff None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.274972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c490b-56dd-4b56-a4a7-f854653337ff None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.275219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c490b-56dd-4b56-a4a7-f854653337ff None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.276715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 167/337] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:36.283025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6bad5-8d8c-4e1b-bf43-f5a9fb529962 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.283309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6bad5-8d8c-4e1b-bf43-f5a9fb529962 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.283585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6bad5-8d8c-4e1b-bf43-f5a9fb529962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.305920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b8c6bad5-8d8c-4e1b-bf43-f5a9fb529962 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:36.307117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b8c6bad5-8d8c-4e1b-bf43-f5a9fb529962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:36.383747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 171/338] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:36.622675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e447fa-ff13-44e8-abf0-ae25b6206b97 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.623036 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e447fa-ff13-44e8-abf0-ae25b6206b97 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.623214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e447fa-ff13-44e8-abf0-ae25b6206b97 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.624834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 168/339] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:36.629747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb853d3-7af1-4e48-aca0-afef123997f7 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.630070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb853d3-7af1-4e48-aca0-afef123997f7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.630348 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb853d3-7af1-4e48-aca0-afef123997f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.654915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-fdb853d3-7af1-4e48-aca0-afef123997f7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:36.656009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fdb853d3-7af1-4e48-aca0-afef123997f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:36.740288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.754487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e447fa-ff13-44e8-abf0-ae25b6206b97 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:36.755378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 172/340] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:36.881639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.911976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e447fa-ff13-44e8-abf0-ae25b6206b97 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:36.939994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb853d3-7af1-4e48-aca0-afef123997f7 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:36.955042 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67707486-f0d7-4f2c-9965-6ae89a713e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:36.955683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707486-f0d7-4f2c-9965-6ae89a713e1b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.955962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707486-f0d7-4f2c-9965-6ae89a713e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.956234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707486-f0d7-4f2c-9965-6ae89a713e1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.978776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67707486-f0d7-4f2c-9965-6ae89a713e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-67707486-f0d7-4f2c-9965-6ae89a713e1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:36.984737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:36.985639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:36.986757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 169/341] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:36.991987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67707486-f0d7-4f2c-9965-6ae89a713e1b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.156598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb853d3-7af1-4e48-aca0-afef123997f7 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.207547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67707486-f0d7-4f2c-9965-6ae89a713e1b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.213384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd87c8-28b8-4567-a690-af4c2632ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.214067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd87c8-28b8-4567-a690-af4c2632ae82 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.214346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd87c8-28b8-4567-a690-af4c2632ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.214669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd87c8-28b8-4567-a690-af4c2632ae82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.229663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd87c8-28b8-4567-a690-af4c2632ae82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-8dcd87c8-28b8-4567-a690-af4c2632ae82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:37.235041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:37.235958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:37.237047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 173/342] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:37.237708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd87c8-28b8-4567-a690-af4c2632ae82 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.258664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.259288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.259568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.259849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.260523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:37.260827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.262925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.274074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.289686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 170/343] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:37.290689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.347262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.439220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd87c8-28b8-4567-a690-af4c2632ae82 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.464954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b741f-7cef-41b1-b986-d0d033470075 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.485021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0920c-1fc9-49b9-8ec0-f667794e331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.485674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0920c-1fc9-49b9-8ec0-f667794e331e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.485985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0920c-1fc9-49b9-8ec0-f667794e331e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.486528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0920c-1fc9-49b9-8ec0-f667794e331e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.501023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0920c-1fc9-49b9-8ec0-f667794e331e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-f8b0920c-1fc9-49b9-8ec0-f667794e331e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:37.507194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:37.508081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:37.508921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:37.509619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc398-12aa-4a23-a687-e40dc13a8238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.509706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 174/344] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:37.509774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc398-12aa-4a23-a687-e40dc13a8238 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.509774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc398-12aa-4a23-a687-e40dc13a8238 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.509939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0920c-1fc9-49b9-8ec0-f667794e331e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.510010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc398-12aa-4a23-a687-e40dc13a8238 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.513863 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc398-12aa-4a23-a687-e40dc13a8238 None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:37.513863 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc398-12aa-4a23-a687-e40dc13a8238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.516026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc398-12aa-4a23-a687-e40dc13a8238 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.526323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 171/345] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:37.537983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d2d3-522c-469b-9a2c-9d8226cbc341 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.537983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d2d3-522c-469b-9a2c-9d8226cbc341 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.537983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d2d3-522c-469b-9a2c-9d8226cbc341 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.537983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 172/346] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:37.537983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d2d3-522c-469b-9a2c-9d8226cbc341 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.616583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.654119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0920c-1fc9-49b9-8ec0-f667794e331e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.661564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d2d3-522c-469b-9a2c-9d8226cbc341 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.669039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.693307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764f3c-13ab-4a06-b20a-dc9ec5ae5dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.693918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764f3c-13ab-4a06-b20a-dc9ec5ae5dac None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.694180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764f3c-13ab-4a06-b20a-dc9ec5ae5dac None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.694449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc764f3c-13ab-4a06-b20a-dc9ec5ae5dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.702454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d0238-7dbe-4b55-9d0f-da88632991fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.703353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d0238-7dbe-4b55-9d0f-da88632991fe None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.703830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d0238-7dbe-4b55-9d0f-da88632991fe None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.704298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d0238-7dbe-4b55-9d0f-da88632991fe None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.705221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d0238-7dbe-4b55-9d0f-da88632991fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:37.705746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d0238-7dbe-4b55-9d0f-da88632991fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.707371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d0238-7dbe-4b55-9d0f-da88632991fe None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.717798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 173/347] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:37.719559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472af450-84e0-46a8-bc41-3f80646e4428 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.720044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472af450-84e0-46a8-bc41-3f80646e4428 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.720534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472af450-84e0-46a8-bc41-3f80646e4428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.739841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-472af450-84e0-46a8-bc41-3f80646e4428 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:37.741615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-472af450-84e0-46a8-bc41-3f80646e4428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:37.781270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc764f3c-13ab-4a06-b20a-dc9ec5ae5dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.782838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc764f3c-13ab-4a06-b20a-dc9ec5ae5dac None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.826956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 174/348] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:37.827634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472af450-84e0-46a8-bc41-3f80646e4428 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.913151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.928969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 175/349] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:37.930280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764f3c-13ab-4a06-b20a-dc9ec5ae5dac None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.946400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.966430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472af450-84e0-46a8-bc41-3f80646e4428 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.005220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bafdf-d261-41d2-8d3c-0e0d92f2d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.005727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bafdf-d261-41d2-8d3c-0e0d92f2d191 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.006054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bafdf-d261-41d2-8d3c-0e0d92f2d191 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.006327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bafdf-d261-41d2-8d3c-0e0d92f2d191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.045742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc764f3c-13ab-4a06-b20a-dc9ec5ae5dac None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.079912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bafdf-d261-41d2-8d3c-0e0d92f2d191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.081492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bafdf-d261-41d2-8d3c-0e0d92f2d191 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.084465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6761b-6b2a-47e4-91bb-d0a9043b2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.085253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6761b-6b2a-47e4-91bb-d0a9043b2b80 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.085671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6761b-6b2a-47e4-91bb-d0a9043b2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.086114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6761b-6b2a-47e4-91bb-d0a9043b2b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.152744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.164572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6761b-6b2a-47e4-91bb-d0a9043b2b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.166804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6761b-6b2a-47e4-91bb-d0a9043b2b80 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.183292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.203858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 175/350] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:38.205144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb836d-a9c5-44bb-8aa1-e0b5dc799a73 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.205426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb836d-a9c5-44bb-8aa1-e0b5dc799a73 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.205702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb836d-a9c5-44bb-8aa1-e0b5dc799a73 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.213541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 176/351] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:38.213541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb836d-a9c5-44bb-8aa1-e0b5dc799a73 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.297624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 176/352] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:38.298452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6761b-6b2a-47e4-91bb-d0a9043b2b80 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.349443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb836d-a9c5-44bb-8aa1-e0b5dc799a73 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.387443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36135c-fe60-4ad6-a581-808c9502bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.388067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36135c-fe60-4ad6-a581-808c9502bafd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.388343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36135c-fe60-4ad6-a581-808c9502bafd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.388611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36135c-fe60-4ad6-a581-808c9502bafd None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.389767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36135c-fe60-4ad6-a581-808c9502bafd None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.391265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36135c-fe60-4ad6-a581-808c9502bafd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.392900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 177/353] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.393659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36135c-fe60-4ad6-a581-808c9502bafd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.421393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.425339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6761b-6b2a-47e4-91bb-d0a9043b2b80 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.443055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.469405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f52a58-a3bc-4eb8-b0cf-a96d2cf1ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.470231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52a58-a3bc-4eb8-b0cf-a96d2cf1ed59 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.470505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52a58-a3bc-4eb8-b0cf-a96d2cf1ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.470782 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f52a58-a3bc-4eb8-b0cf-a96d2cf1ed59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.485943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f52a58-a3bc-4eb8-b0cf-a96d2cf1ed59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-56f52a58-a3bc-4eb8-b0cf-a96d2cf1ed59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:38.491825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:38.492731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:38.493571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 177/354] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:38.494295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee5f93-fa98-4ed6-904c-5056e5a86eba None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.494841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee5f93-fa98-4ed6-904c-5056e5a86eba None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.494841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee5f93-fa98-4ed6-904c-5056e5a86eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.516217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-41ee5f93-fa98-4ed6-904c-5056e5a86eba None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:38.517418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-41ee5f93-fa98-4ed6-904c-5056e5a86eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:38.518475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36135c-fe60-4ad6-a581-808c9502bafd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.573228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2c01-bc40-439a-a17d-f702b721a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.574274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2c01-bc40-439a-a17d-f702b721a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.574802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2c01-bc40-439a-a17d-f702b721a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.575306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2c01-bc40-439a-a17d-f702b721a5c1 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.576733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf2c01-bc40-439a-a17d-f702b721a5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.578340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf2c01-bc40-439a-a17d-f702b721a5c1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.580306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 178/355] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.581495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005c2be-4070-4d4f-92d3-3adad7d8053e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.581777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005c2be-4070-4d4f-92d3-3adad7d8053e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.582107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005c2be-4070-4d4f-92d3-3adad7d8053e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.583337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 179/356] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:38.586502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005c2be-4070-4d4f-92d3-3adad7d8053e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.601872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 178/357] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:38.608719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee5f93-fa98-4ed6-904c-5056e5a86eba None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.716790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.728659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005c2be-4070-4d4f-92d3-3adad7d8053e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.734111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee5f93-fa98-4ed6-904c-5056e5a86eba None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.736803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.776167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de2662-09a4-4718-95fd-a63b33488bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.776399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e15ef-072c-4b47-93e3-3ba027502328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.776807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de2662-09a4-4718-95fd-a63b33488bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.777547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e15ef-072c-4b47-93e3-3ba027502328 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.777647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de2662-09a4-4718-95fd-a63b33488bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.777927 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de2662-09a4-4718-95fd-a63b33488bc2 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.778039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e15ef-072c-4b47-93e3-3ba027502328 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.778237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e15ef-072c-4b47-93e3-3ba027502328 None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.779060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de2662-09a4-4718-95fd-a63b33488bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.780499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de2662-09a4-4718-95fd-a63b33488bc2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.782602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 180/358] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.783038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de2662-09a4-4718-95fd-a63b33488bc2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.784774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e15ef-072c-4b47-93e3-3ba027502328 None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.786367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e15ef-072c-4b47-93e3-3ba027502328 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.788522 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 179/359] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.794585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e15ef-072c-4b47-93e3-3ba027502328 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.905038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de2662-09a4-4718-95fd-a63b33488bc2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.931044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e15ef-072c-4b47-93e3-3ba027502328 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.943376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5e6d-5ef2-44ea-9292-74cea02c0562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.944259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5e6d-5ef2-44ea-9292-74cea02c0562 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.944543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5e6d-5ef2-44ea-9292-74cea02c0562 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.944818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5e6d-5ef2-44ea-9292-74cea02c0562 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.945485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d5e6d-5ef2-44ea-9292-74cea02c0562 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:38.945787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d5e6d-5ef2-44ea-9292-74cea02c0562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.947194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d5e6d-5ef2-44ea-9292-74cea02c0562 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.955726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 181/360] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.956949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58238-a687-455e-9fc1-a5603f7f41aa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.957230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58238-a687-455e-9fc1-a5603f7f41aa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.957506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b58238-a687-455e-9fc1-a5603f7f41aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.974479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27446d00-f2cd-405e-a9d1-c9ca0d2c2931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.975131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27446d00-f2cd-405e-a9d1-c9ca0d2c2931 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.975398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27446d00-f2cd-405e-a9d1-c9ca0d2c2931 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.975672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27446d00-f2cd-405e-a9d1-c9ca0d2c2931 None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.976768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27446d00-f2cd-405e-a9d1-c9ca0d2c2931 None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.976873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-00b58238-a687-455e-9fc1-a5603f7f41aa None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:38.978029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-00b58238-a687-455e-9fc1-a5603f7f41aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:38.978270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27446d00-f2cd-405e-a9d1-c9ca0d2c2931 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.980013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 180/361] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.980701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27446d00-f2cd-405e-a9d1-c9ca0d2c2931 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.998176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.023236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.066514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 182/362] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:39.066730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b58238-a687-455e-9fc1-a5603f7f41aa None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.119494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27446d00-f2cd-405e-a9d1-c9ca0d2c2931 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.174478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd230-8fb0-4348-82d6-b045a0164ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.175085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd230-8fb0-4348-82d6-b045a0164ebc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.175337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd230-8fb0-4348-82d6-b045a0164ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.175713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd230-8fb0-4348-82d6-b045a0164ebc None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.177123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fd230-8fb0-4348-82d6-b045a0164ebc None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.178742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fd230-8fb0-4348-82d6-b045a0164ebc None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.180840 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 181/363] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.186532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd230-8fb0-4348-82d6-b045a0164ebc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.187147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b58238-a687-455e-9fc1-a5603f7f41aa None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.238412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.239193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.239368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.241416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.241416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] RBAC: Adding query filter params (group.id=ad87a11a716844d3a3deb4b3940273eb, role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=60e78e00233e4cec80710a489bd078ea) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:39.241416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.243125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.251845 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 183/364] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/role_assignments?group.id=ad87a11a716844d3a3deb4b3940273eb&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.252673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.298248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.323691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd230-8fb0-4348-82d6-b045a0164ebc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.327181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.369798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9325-8a46-44b5-90ff-42eb2010a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.370540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9325-8a46-44b5-90ff-42eb2010a293 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.370895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9325-8a46-44b5-90ff-42eb2010a293 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.371214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9325-8a46-44b5-90ff-42eb2010a293 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.385359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9325-8a46-44b5-90ff-42eb2010a293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-f3de9325-8a46-44b5-90ff-42eb2010a293 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:39.391827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:39.392803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:39.393894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 182/365] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:39.394578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9325-8a46-44b5-90ff-42eb2010a293 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.424225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e184697-6ee6-4402-8eb0-7f6893d0fb25 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.465887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f4405-0dea-4261-8e10-3dee7cbe4209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.466499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4405-0dea-4261-8e10-3dee7cbe4209 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.466775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4405-0dea-4261-8e10-3dee7cbe4209 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.467039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4405-0dea-4261-8e10-3dee7cbe4209 None admin] PATH_INFO: `/v3/users/b6df61c5152a47ddab681e121d91d903` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.469887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f4405-0dea-4261-8e10-3dee7cbe4209 None admin] RBAC: Authorizing `identity:get_user(user_id=b6df61c5152a47ddab681e121d91d903)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.470385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f4405-0dea-4261-8e10-3dee7cbe4209 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.472347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/users/b6df61c5152a47ddab681e121d91d903 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.473188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f4405-0dea-4261-8e10-3dee7cbe4209 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.536695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9325-8a46-44b5-90ff-42eb2010a293 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.583250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.592081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.592081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.592081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.592461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.592972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] RBAC: Adding query filter params (group.id=ad87a11a716844d3a3deb4b3940273eb, role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=60e78e00233e4cec80710a489bd078ea) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:39.593287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.595309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.601474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 183/367] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/role_assignments?group.id=ad87a11a716844d3a3deb4b3940273eb&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=a92b62fe43214de0b1468165da0d5456 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.602260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.613495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f4405-0dea-4261-8e10-3dee7cbe4209 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.644821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.659917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.660553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.660834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.661110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.661885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] RBAC: Adding query filter params (group.id=ad87a11a716844d3a3deb4b3940273eb, role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=c6a772c0c77e453aab85badccdb10dc0) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:39.662204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.663712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.671174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 185/368] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/role_assignments?group.id=ad87a11a716844d3a3deb4b3940273eb&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=a92b62fe43214de0b1468165da0d5456 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.672052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.779179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34347c1-4f2d-49a2-a9bd-107468b9a9f4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.844872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c4272-cbf3-4623-b152-829c6110cbb9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.848334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d6d2f-94e6-4858-9d13-c4b5e4fee23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.848985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d6d2f-94e6-4858-9d13-c4b5e4fee23d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.850311 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d6d2f-94e6-4858-9d13-c4b5e4fee23d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.850598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d6d2f-94e6-4858-9d13-c4b5e4fee23d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.864791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d6d2f-94e6-4858-9d13-c4b5e4fee23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-db9d6d2f-94e6-4858-9d13-c4b5e4fee23d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:39.873936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:39.874892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 184/369] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:39.875723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d6d2f-94e6-4858-9d13-c4b5e4fee23d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.906072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.907066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.907570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.908047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.908916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:39.909422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.911092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.920717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 186/370] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.921920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.938506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.991188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.014234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d6d2f-94e6-4858-9d13-c4b5e4fee23d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.052175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38d5f6-22de-44d5-b60f-7e0d1232eb8b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.064701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.065318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.065599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.066813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.067675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] RBAC: Adding query filter params (role.id=6e8157956e274229a88aa603c4957f33, user.id=b6df61c5152a47ddab681e121d91d903, scope.system=all) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:40.067985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.070152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.086787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 185/371] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/role_assignments?user.id=b6df61c5152a47ddab681e121d91d903&scope.system=all&role.id=6e8157956e274229a88aa603c4957f33 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:40.087976 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.098494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.099114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.099396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.099673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.101059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:40.101377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.106093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.116972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 187/372] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:40.126520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.208549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a736-eed3-4af1-b9b1-0c263cc4c571 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.242783 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.252468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475139d9-b96a-4a6c-b0b8-133e9eeb5317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.253204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475139d9-b96a-4a6c-b0b8-133e9eeb5317 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.253558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475139d9-b96a-4a6c-b0b8-133e9eeb5317 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.253937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475139d9-b96a-4a6c-b0b8-133e9eeb5317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.272161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.327131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310400e6-a26a-4963-b861-e239f4ee95ac None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.336942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475139d9-b96a-4a6c-b0b8-133e9eeb5317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.338652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475139d9-b96a-4a6c-b0b8-133e9eeb5317 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.400374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042ed9-185b-4f03-a5a8-318f8d6e1d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.401118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042ed9-185b-4f03-a5a8-318f8d6e1d56 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.401407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042ed9-185b-4f03-a5a8-318f8d6e1d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.401689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042ed9-185b-4f03-a5a8-318f8d6e1d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.461904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 186/373] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:40.464824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475139d9-b96a-4a6c-b0b8-133e9eeb5317 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.512339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042ed9-185b-4f03-a5a8-318f8d6e1d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.515145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.518743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042ed9-185b-4f03-a5a8-318f8d6e1d56 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.577273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475139d9-b96a-4a6c-b0b8-133e9eeb5317 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.614965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288605c-4e80-4db2-9b81-a42679ee4155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.615611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288605c-4e80-4db2-9b81-a42679ee4155 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.615895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288605c-4e80-4db2-9b81-a42679ee4155 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.616170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288605c-4e80-4db2-9b81-a42679ee4155 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.617303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288605c-4e80-4db2-9b81-a42679ee4155 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.619605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288605c-4e80-4db2-9b81-a42679ee4155 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.621398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 187/374] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:40.632995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.634809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288605c-4e80-4db2-9b81-a42679ee4155 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.703884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 188/375] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:26:40.709190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042ed9-185b-4f03-a5a8-318f8d6e1d56 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.775682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288605c-4e80-4db2-9b81-a42679ee4155 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.790256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.813428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbda397-e983-47ae-8697-6b3349f0ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.814125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbda397-e983-47ae-8697-6b3349f0ee55 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.814418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbda397-e983-47ae-8697-6b3349f0ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.814698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbda397-e983-47ae-8697-6b3349f0ee55 None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.815918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbda397-e983-47ae-8697-6b3349f0ee55 None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.817409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbda397-e983-47ae-8697-6b3349f0ee55 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.819552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 188/376] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:40.825504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbda397-e983-47ae-8697-6b3349f0ee55 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.935249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbda397-e983-47ae-8697-6b3349f0ee55 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.972027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.972643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.972926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.973243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.973964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] RBAC: Adding query filter params (group.id=ad87a11a716844d3a3deb4b3940273eb, role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=c6a772c0c77e453aab85badccdb10dc0) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:40.974277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.975739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.977620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042ed9-185b-4f03-a5a8-318f8d6e1d56 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.982295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 189/377] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/role_assignments?group.id=ad87a11a716844d3a3deb4b3940273eb&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:41.040702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682366e0-620d-4411-8f41-61620db526e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.041352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682366e0-620d-4411-8f41-61620db526e7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.041636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682366e0-620d-4411-8f41-61620db526e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.041938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682366e0-620d-4411-8f41-61620db526e7 None admin] PATH_INFO: `/v3/projects/e63b0c3551a8436a97c9341435afc499` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.046596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682366e0-620d-4411-8f41-61620db526e7 None admin] RBAC: Authorizing `identity:get_project(project_id=e63b0c3551a8436a97c9341435afc499)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:41.048147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682366e0-620d-4411-8f41-61620db526e7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.049859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 189/378] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/projects/e63b0c3551a8436a97c9341435afc499 => generated 344 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:41.055513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:41.108444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:41.169249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4602b8-afa8-459c-803c-9655cc552ca7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.206191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35848af-ae25-4cf0-a388-d1898730a2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.206749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35848af-ae25-4cf0-a388-d1898730a2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.207032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35848af-ae25-4cf0-a388-d1898730a2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.207312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35848af-ae25-4cf0-a388-d1898730a2f5 None admin] PATH_INFO: `/v3/groups/3bbe3c1a66d04b8f8dedb675662cb1fd` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.212599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35848af-ae25-4cf0-a388-d1898730a2f5 None admin] RBAC: Authorizing `identity:get_group(group_id=3bbe3c1a66d04b8f8dedb675662cb1fd)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:41.214142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35848af-ae25-4cf0-a388-d1898730a2f5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.216264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 190/379] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:41 2022] GET /identity/v3/groups/3bbe3c1a66d04b8f8dedb675662cb1fd => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:41.221741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682366e0-620d-4411-8f41-61620db526e7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:41.268126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:41.332302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682366e0-620d-4411-8f41-61620db526e7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.374944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eac90-271c-4776-b958-797dcbd7eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.375566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eac90-271c-4776-b958-797dcbd7eada None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.375850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eac90-271c-4776-b958-797dcbd7eada None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.376126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eac90-271c-4776-b958-797dcbd7eada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.376872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eac90-271c-4776-b958-797dcbd7eada None admin] RBAC: Adding query filter params (group.id=3bbe3c1a66d04b8f8dedb675662cb1fd, role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=e63b0c3551a8436a97c9341435afc499) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:41.377182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eac90-271c-4776-b958-797dcbd7eada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:41.378757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eac90-271c-4776-b958-797dcbd7eada None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.385590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 190/380] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:41 2022] GET /identity/v3/role_assignments?group.id=3bbe3c1a66d04b8f8dedb675662cb1fd&scope.project.id=e63b0c3551a8436a97c9341435afc499&role.id=cac8d7ae8325488684667d62304b0860 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:41.666425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babc35-82fd-470b-8ef4-d2273c101e0d None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.666818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babc35-82fd-470b-8ef4-d2273c101e0d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.667016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00babc35-82fd-470b-8ef4-d2273c101e0d None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.669240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 191/381] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:41.674733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de019a-4631-47cc-af8f-101483d66f59 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.675306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de019a-4631-47cc-af8f-101483d66f59 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.675791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de019a-4631-47cc-af8f-101483d66f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.698168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f1de019a-4631-47cc-af8f-101483d66f59 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:41.699796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f1de019a-4631-47cc-af8f-101483d66f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:41.780272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 191/382] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:42.195938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00babc35-82fd-470b-8ef4-d2273c101e0d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.318376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00babc35-82fd-470b-8ef4-d2273c101e0d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.328081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:42.358119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947728d-cd3f-41c8-a0a2-74f47ce89251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.358768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947728d-cd3f-41c8-a0a2-74f47ce89251 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.359051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947728d-cd3f-41c8-a0a2-74f47ce89251 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.359324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947728d-cd3f-41c8-a0a2-74f47ce89251 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.360576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37d31-d075-41bd-8560-6f09c8c37079 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.361663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37d31-d075-41bd-8560-6f09c8c37079 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.362179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37d31-d075-41bd-8560-6f09c8c37079 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.363997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 192/383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:42.369159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36467457-6161-4ece-8ca0-fc6e088de823 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.369699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36467457-6161-4ece-8ca0-fc6e088de823 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.370209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36467457-6161-4ece-8ca0-fc6e088de823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.372455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947728d-cd3f-41c8-a0a2-74f47ce89251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-7947728d-cd3f-41c8-a0a2-74f47ce89251 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:42.377508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:42.378568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:42.379401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 192/384] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:42.380110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd33a-fa30-4707-ac46-5e8e84cb9f92 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.380692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd33a-fa30-4707-ac46-5e8e84cb9f92 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.380692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd33a-fa30-4707-ac46-5e8e84cb9f92 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.382753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 193/385] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:42.384049 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd33a-fa30-4707-ac46-5e8e84cb9f92 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.394497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-36467457-6161-4ece-8ca0-fc6e088de823 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:42.396003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-36467457-6161-4ece-8ca0-fc6e088de823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:42.423725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:42.469355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 193/386] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:42.475283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab112c-1cb0-4fcf-800d-4e8d085a4a07 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.475788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab112c-1cb0-4fcf-800d-4e8d085a4a07 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.476248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab112c-1cb0-4fcf-800d-4e8d085a4a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.495039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd33a-fa30-4707-ac46-5e8e84cb9f92 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.514579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d9ab112c-1cb0-4fcf-800d-4e8d085a4a07 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:42.516034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d9ab112c-1cb0-4fcf-800d-4e8d085a4a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:42.532916 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.533581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.533890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.534175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.534906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:42.535200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:42.536636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:42.546143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 194/387] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:42.554874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.611509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:42.634245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 194/388] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:42.722453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c540b-ebb4-44f3-8973-224727cb413d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.778568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791491b8-fed0-403a-93c8-51952c34345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.779216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791491b8-fed0-403a-93c8-51952c34345e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.779502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791491b8-fed0-403a-93c8-51952c34345e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.779777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791491b8-fed0-403a-93c8-51952c34345e None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.781001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791491b8-fed0-403a-93c8-51952c34345e None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:42.782476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791491b8-fed0-403a-93c8-51952c34345e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:42.784215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 195/389] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:42.789584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab112c-1cb0-4fcf-800d-4e8d085a4a07 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.895532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:42.911062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab112c-1cb0-4fcf-800d-4e8d085a4a07 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.935533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791491b8-fed0-403a-93c8-51952c34345e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.955903 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202c408-5747-430a-afef-86b45bbbd40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.956948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202c408-5747-430a-afef-86b45bbbd40c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.957485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202c408-5747-430a-afef-86b45bbbd40c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.957990 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202c408-5747-430a-afef-86b45bbbd40c None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.959430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202c408-5747-430a-afef-86b45bbbd40c None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:42.961132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202c408-5747-430a-afef-86b45bbbd40c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:42.963294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 195/390] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:42.965118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202c408-5747-430a-afef-86b45bbbd40c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.070953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.075287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791491b8-fed0-403a-93c8-51952c34345e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.089991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202c408-5747-430a-afef-86b45bbbd40c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.128783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdddf5-244c-430b-aed6-f33c07e774ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.129697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdddf5-244c-430b-aed6-f33c07e774ab None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.130196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdddf5-244c-430b-aed6-f33c07e774ab None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.130660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdddf5-244c-430b-aed6-f33c07e774ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.130774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842afbb0-8754-4b46-9968-7f146a85548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.131341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842afbb0-8754-4b46-9968-7f146a85548b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.131620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842afbb0-8754-4b46-9968-7f146a85548b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.131896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842afbb0-8754-4b46-9968-7f146a85548b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.145749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842afbb0-8754-4b46-9968-7f146a85548b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-842afbb0-8754-4b46-9968-7f146a85548b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:43.150460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:43.151353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:43.152739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 196/391] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:43.153764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842afbb0-8754-4b46-9968-7f146a85548b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.159213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdddf5-244c-430b-aed6-f33c07e774ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-62cdddf5-244c-430b-aed6-f33c07e774ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:43.163705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:43.164578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:43.165365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:43.170002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 196/392] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:43.170858 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdddf5-244c-430b-aed6-f33c07e774ab None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.188466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.287048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842afbb0-8754-4b46-9968-7f146a85548b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.299531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdddf5-244c-430b-aed6-f33c07e774ab None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.325711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9980f0c-d0e3-450b-9747-87c45bc4f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.326689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980f0c-d0e3-450b-9747-87c45bc4f5a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.326870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980f0c-d0e3-450b-9747-87c45bc4f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.327124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980f0c-d0e3-450b-9747-87c45bc4f5a1 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea/groups/ad87a11a716844d3a3deb4b3940273eb/roles/2e0116277dbb4c08a7ca7e300f7faa53` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.329396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9980f0c-d0e3-450b-9747-87c45bc4f5a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=60e78e00233e4cec80710a489bd078ea, group_id=ad87a11a716844d3a3deb4b3940273eb, role_id=2e0116277dbb4c08a7ca7e300f7faa53)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.331188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9980f0c-d0e3-450b-9747-87c45bc4f5a1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.344835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.346178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.346656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.347123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.347434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 197/393] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:43 2022] PUT /identity/v3/projects/60e78e00233e4cec80710a489bd078ea/groups/ad87a11a716844d3a3deb4b3940273eb/roles/2e0116277dbb4c08a7ca7e300f7faa53 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:43.348262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:43.348375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9980f0c-d0e3-450b-9747-87c45bc4f5a1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.348875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.350584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.363227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 197/394] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:43.369042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.423920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.522250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.551142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9980f0c-d0e3-450b-9747-87c45bc4f5a1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.569413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20557f-6e66-48ae-ac10-6f2bac37b360 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.596654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.597534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.597993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.598445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.599596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:43.600064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.601825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.611828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 198/395] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:43.617785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.640597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0bffa-3d22-4fe4-ba16-7a4d6a93e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.642891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0bffa-3d22-4fe4-ba16-7a4d6a93e09d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.643322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0bffa-3d22-4fe4-ba16-7a4d6a93e09d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.643973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0bffa-3d22-4fe4-ba16-7a4d6a93e09d None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.646150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0bffa-3d22-4fe4-ba16-7a4d6a93e09d None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.650393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0bffa-3d22-4fe4-ba16-7a4d6a93e09d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.652313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 198/396] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:43.658078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0bffa-3d22-4fe4-ba16-7a4d6a93e09d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.751047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd8817-48c5-45df-ac3e-bdc49c68537a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.770861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.783870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0bffa-3d22-4fe4-ba16-7a4d6a93e09d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.794895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0192c3-a96e-406e-898c-f1ad0fc18b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.795915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0192c3-a96e-406e-898c-f1ad0fc18b26 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.796406 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0192c3-a96e-406e-898c-f1ad0fc18b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.796925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0192c3-a96e-406e-898c-f1ad0fc18b26 None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.798345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0192c3-a96e-406e-898c-f1ad0fc18b26 None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.800104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0192c3-a96e-406e-898c-f1ad0fc18b26 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.802374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 199/397] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:43.803701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d7c8a-41d7-47d0-8542-ed78ed0283d1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.804173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d7c8a-41d7-47d0-8542-ed78ed0283d1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.804653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d7c8a-41d7-47d0-8542-ed78ed0283d1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.806649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 200/398] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:43.807590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d7c8a-41d7-47d0-8542-ed78ed0283d1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.820729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965af35-1703-48dc-92a2-0d953779e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.821254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965af35-1703-48dc-92a2-0d953779e96e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.821538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965af35-1703-48dc-92a2-0d953779e96e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.821812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965af35-1703-48dc-92a2-0d953779e96e None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.823056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.824344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965af35-1703-48dc-92a2-0d953779e96e None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.826066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965af35-1703-48dc-92a2-0d953779e96e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.828220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 199/399] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:43.829632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638eae-62a1-4ee7-ab77-91f77f8eb6b5 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.830145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638eae-62a1-4ee7-ab77-91f77f8eb6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.830632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23638eae-62a1-4ee7-ab77-91f77f8eb6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.851147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-23638eae-62a1-4ee7-ab77-91f77f8eb6b5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:43.852674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-23638eae-62a1-4ee7-ab77-91f77f8eb6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:43.922155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d7c8a-41d7-47d0-8542-ed78ed0283d1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.928052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 200/400] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:43.933868 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23638eae-62a1-4ee7-ab77-91f77f8eb6b5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.969614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229ebb2-0fe7-49ce-819d-dfffac36a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.970285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229ebb2-0fe7-49ce-819d-dfffac36a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.970822 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229ebb2-0fe7-49ce-819d-dfffac36a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.971101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229ebb2-0fe7-49ce-819d-dfffac36a5e5 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.972912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229ebb2-0fe7-49ce-819d-dfffac36a5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.974679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229ebb2-0fe7-49ce-819d-dfffac36a5e5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.977535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 201/401] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:43.978789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7adbbc-c3bd-4ac4-bfb5-2db77bc0835f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.979077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7adbbc-c3bd-4ac4-bfb5-2db77bc0835f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.979356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7adbbc-c3bd-4ac4-bfb5-2db77bc0835f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.985986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 202/402] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:43.987017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7adbbc-c3bd-4ac4-bfb5-2db77bc0835f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.036853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.056765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23638eae-62a1-4ee7-ab77-91f77f8eb6b5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.094891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.096899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ad3f1-18cd-4d31-b2ea-f9e7260475e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.097588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad3f1-18cd-4d31-b2ea-f9e7260475e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.097890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad3f1-18cd-4d31-b2ea-f9e7260475e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.098176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad3f1-18cd-4d31-b2ea-f9e7260475e2 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea/groups/ad87a11a716844d3a3deb4b3940273eb/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.100664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ad3f1-18cd-4d31-b2ea-f9e7260475e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=60e78e00233e4cec80710a489bd078ea, group_id=ad87a11a716844d3a3deb4b3940273eb, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:44.102594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ad3f1-18cd-4d31-b2ea-f9e7260475e2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:44.120338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 201/403] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:43 2022] PUT /identity/v3/projects/60e78e00233e4cec80710a489bd078ea/groups/ad87a11a716844d3a3deb4b3940273eb/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:44.126084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7adbbc-c3bd-4ac4-bfb5-2db77bc0835f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.127474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aca10-c04c-4c5d-b927-454c48535431 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.127769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aca10-c04c-4c5d-b927-454c48535431 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.128053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aca10-c04c-4c5d-b927-454c48535431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.157757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-7e0aca10-c04c-4c5d-b927-454c48535431 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:44.159576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7e0aca10-c04c-4c5d-b927-454c48535431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:44.176568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5590c-d9e6-4d72-96ce-5ca8aaf76ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.177262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5590c-d9e6-4d72-96ce-5ca8aaf76ecb None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.177549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5590c-d9e6-4d72-96ce-5ca8aaf76ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.177871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5590c-d9e6-4d72-96ce-5ca8aaf76ecb None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0/groups/ad87a11a716844d3a3deb4b3940273eb/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.180378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5590c-d9e6-4d72-96ce-5ca8aaf76ecb None admin] RBAC: Authorizing `identity:create_grant(project_id=c6a772c0c77e453aab85badccdb10dc0, group_id=ad87a11a716844d3a3deb4b3940273eb, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:44.182236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5590c-d9e6-4d72-96ce-5ca8aaf76ecb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:44.210247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 203/404] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:43 2022] PUT /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0/groups/ad87a11a716844d3a3deb4b3940273eb/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:44.266021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 202/405] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:44.277259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5590c-d9e6-4d72-96ce-5ca8aaf76ecb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.393971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5590c-d9e6-4d72-96ce-5ca8aaf76ecb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.437695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de88bd-ed18-409b-97d1-1f49012020e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.438369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de88bd-ed18-409b-97d1-1f49012020e1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.438654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de88bd-ed18-409b-97d1-1f49012020e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.438931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de88bd-ed18-409b-97d1-1f49012020e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.447585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.458760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de88bd-ed18-409b-97d1-1f49012020e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-33de88bd-ed18-409b-97d1-1f49012020e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:44.463585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:44.465485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:44.466602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 204/406] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:44.472000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aca10-c04c-4c5d-b927-454c48535431 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.565891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.587006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de88bd-ed18-409b-97d1-1f49012020e1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.615930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aca10-c04c-4c5d-b927-454c48535431 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.662588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.663956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.664477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.664946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.666116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:44.666620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:44.669070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:44.684944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 203/407] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:44.687665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.805363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de88bd-ed18-409b-97d1-1f49012020e1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.811046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3989a-f866-46ce-a594-bb84b0666c0b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.842354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692489f-0b8b-4f8c-a4c9-637bc3a7118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.843028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692489f-0b8b-4f8c-a4c9-637bc3a7118a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.843272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692489f-0b8b-4f8c-a4c9-637bc3a7118a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.843557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692489f-0b8b-4f8c-a4c9-637bc3a7118a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.854313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692489f-0b8b-4f8c-a4c9-637bc3a7118a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:44.859257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620335b9-c7c5-4f79-a6fe-768d517eb6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2692489f-0b8b-4f8c-a4c9-637bc3a7118a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:44.859932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:44.860802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:44.862529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 205/408] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:44.863942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620335b9-c7c5-4f79-a6fe-768d517eb6ff None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.864448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620335b9-c7c5-4f79-a6fe-768d517eb6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.864912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620335b9-c7c5-4f79-a6fe-768d517eb6ff None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.866461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620335b9-c7c5-4f79-a6fe-768d517eb6ff None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:44.867527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692489f-0b8b-4f8c-a4c9-637bc3a7118a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.868479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620335b9-c7c5-4f79-a6fe-768d517eb6ff None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:44.875644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 204/409] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:44.877367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620335b9-c7c5-4f79-a6fe-768d517eb6ff None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.888354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.999555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620335b9-c7c5-4f79-a6fe-768d517eb6ff None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.027691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.043472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41abf8-0f70-4478-9cff-69362fc89e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.044875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41abf8-0f70-4478-9cff-69362fc89e46 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.045367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41abf8-0f70-4478-9cff-69362fc89e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.045855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41abf8-0f70-4478-9cff-69362fc89e46 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.047229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41abf8-0f70-4478-9cff-69362fc89e46 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.048875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41abf8-0f70-4478-9cff-69362fc89e46 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.056474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 205/410] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:45.058277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41abf8-0f70-4478-9cff-69362fc89e46 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.148071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692489f-0b8b-4f8c-a4c9-637bc3a7118a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.149180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.181991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41abf8-0f70-4478-9cff-69362fc89e46 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.222706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d72b9f-af52-4c25-ad71-11e1ab8a053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.223731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d72b9f-af52-4c25-ad71-11e1ab8a053d None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.224229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d72b9f-af52-4c25-ad71-11e1ab8a053d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.224700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d72b9f-af52-4c25-ad71-11e1ab8a053d None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0/groups/ad87a11a716844d3a3deb4b3940273eb/roles/2e0116277dbb4c08a7ca7e300f7faa53` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.227214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d72b9f-af52-4c25-ad71-11e1ab8a053d None admin] RBAC: Authorizing `identity:create_grant(project_id=c6a772c0c77e453aab85badccdb10dc0, group_id=ad87a11a716844d3a3deb4b3940273eb, role_id=2e0116277dbb4c08a7ca7e300f7faa53)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.228927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d72b9f-af52-4c25-ad71-11e1ab8a053d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.235566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06344840-7e32-45cd-adbf-67c2e2b9d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.236458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344840-7e32-45cd-adbf-67c2e2b9d0ca None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.236805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344840-7e32-45cd-adbf-67c2e2b9d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.237008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06344840-7e32-45cd-adbf-67c2e2b9d0ca None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.237637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06344840-7e32-45cd-adbf-67c2e2b9d0ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:45.237977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06344840-7e32-45cd-adbf-67c2e2b9d0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.239368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06344840-7e32-45cd-adbf-67c2e2b9d0ca None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.248565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 206/411] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:45 2022] PUT /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0/groups/ad87a11a716844d3a3deb4b3940273eb/roles/2e0116277dbb4c08a7ca7e300f7faa53 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:45.260387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 206/412] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:45.266418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d72b9f-af52-4c25-ad71-11e1ab8a053d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.431652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d72b9f-af52-4c25-ad71-11e1ab8a053d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.460861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444729b-0faf-4058-a44a-49ee5d0d5b3f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.461144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444729b-0faf-4058-a44a-49ee5d0d5b3f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.461415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444729b-0faf-4058-a44a-49ee5d0d5b3f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.463266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 207/413] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:45.469893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9d03-1718-40cc-851f-ebb23b6be9f0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.470186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9d03-1718-40cc-851f-ebb23b6be9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.470469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9d03-1718-40cc-851f-ebb23b6be9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.472278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde157d-9664-44ce-ab64-c47485412baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.472913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde157d-9664-44ce-ab64-c47485412baa None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.473189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde157d-9664-44ce-ab64-c47485412baa None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.473457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde157d-9664-44ce-ab64-c47485412baa None admin] PATH_INFO: `/v3/groups/3bbe3c1a66d04b8f8dedb675662cb1fd` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.474569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde157d-9664-44ce-ab64-c47485412baa None admin] RBAC: Authorizing `identity:get_group(group_id=3bbe3c1a66d04b8f8dedb675662cb1fd)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.476074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde157d-9664-44ce-ab64-c47485412baa None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.477917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 207/414] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/groups/3bbe3c1a66d04b8f8dedb675662cb1fd => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:45.484300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde157d-9664-44ce-ab64-c47485412baa None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.487384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.495325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4acf9d03-1718-40cc-851f-ebb23b6be9f0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:45.496837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4acf9d03-1718-40cc-851f-ebb23b6be9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:45.580893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 208/415] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:45.628746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde157d-9664-44ce-ab64-c47485412baa None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.673324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338448d-542f-4283-875b-7d0c1ae80cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.673997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338448d-542f-4283-875b-7d0c1ae80cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.674280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338448d-542f-4283-875b-7d0c1ae80cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.674552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338448d-542f-4283-875b-7d0c1ae80cc7 None admin] PATH_INFO: `/v3/projects/e63b0c3551a8436a97c9341435afc499` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.675694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338448d-542f-4283-875b-7d0c1ae80cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=e63b0c3551a8436a97c9341435afc499)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.677159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338448d-542f-4283-875b-7d0c1ae80cc7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.679132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 208/416] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/projects/e63b0c3551a8436a97c9341435afc499 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:45.685368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9d03-1718-40cc-851f-ebb23b6be9f0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.765345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.818057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9d03-1718-40cc-851f-ebb23b6be9f0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.853984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8106-070b-48bf-a42c-1d9a070c814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.854555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8106-070b-48bf-a42c-1d9a070c814e None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.854928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8106-070b-48bf-a42c-1d9a070c814e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.855673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8106-070b-48bf-a42c-1d9a070c814e None admin] PATH_INFO: `/v3/projects/e63b0c3551a8436a97c9341435afc499/groups/3bbe3c1a66d04b8f8dedb675662cb1fd/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.857601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8106-070b-48bf-a42c-1d9a070c814e None admin] RBAC: Authorizing `identity:create_grant(project_id=e63b0c3551a8436a97c9341435afc499, group_id=3bbe3c1a66d04b8f8dedb675662cb1fd, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.859117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8106-070b-48bf-a42c-1d9a070c814e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.878427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 209/417] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:45 2022] PUT /identity/v3/projects/e63b0c3551a8436a97c9341435afc499/groups/3bbe3c1a66d04b8f8dedb675662cb1fd/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:45.993804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338448d-542f-4283-875b-7d0c1ae80cc7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.092483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.133239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338448d-542f-4283-875b-7d0c1ae80cc7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.178745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d60a12-61ac-49d8-99b9-bf3ca7e276e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.179388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d60a12-61ac-49d8-99b9-bf3ca7e276e1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.179673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d60a12-61ac-49d8-99b9-bf3ca7e276e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.179950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d60a12-61ac-49d8-99b9-bf3ca7e276e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.199324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d60a12-61ac-49d8-99b9-bf3ca7e276e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-53d60a12-61ac-49d8-99b9-bf3ca7e276e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:46.204673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:46.205563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:46.206390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 209/418] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:46.213237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8106-070b-48bf-a42c-1d9a070c814e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.337100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8106-070b-48bf-a42c-1d9a070c814e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.362237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.374694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f6bdc-9b46-495c-9abe-4d5c43628cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.375314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6bdc-9b46-495c-9abe-4d5c43628cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.375605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6bdc-9b46-495c-9abe-4d5c43628cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.376372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6bdc-9b46-495c-9abe-4d5c43628cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.377206 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f6bdc-9b46-495c-9abe-4d5c43628cc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:46.377596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f6bdc-9b46-495c-9abe-4d5c43628cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.379102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f6bdc-9b46-495c-9abe-4d5c43628cc2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.388895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 210/419] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:46.394325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d60a12-61ac-49d8-99b9-bf3ca7e276e1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.524128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d60a12-61ac-49d8-99b9-bf3ca7e276e1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.559354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.566425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ecc8d-cd5d-4e08-b292-a002697d5fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.567226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecc8d-cd5d-4e08-b292-a002697d5fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.567510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecc8d-cd5d-4e08-b292-a002697d5fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.567784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecc8d-cd5d-4e08-b292-a002697d5fc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.639751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ecc8d-cd5d-4e08-b292-a002697d5fc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.641166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ecc8d-cd5d-4e08-b292-a002697d5fc7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.775492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3ba8a-534a-48e0-8383-3f11fd94fe89 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.776003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3ba8a-534a-48e0-8383-3f11fd94fe89 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.776101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3ba8a-534a-48e0-8383-3f11fd94fe89 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.777523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 211/420] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:46.778283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 210/421] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:46.783334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600c58-98d9-4efa-b23c-e856dcec3f6b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.783625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600c58-98d9-4efa-b23c-e856dcec3f6b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.783908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82600c58-98d9-4efa-b23c-e856dcec3f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.786653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ecc8d-cd5d-4e08-b292-a002697d5fc7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.813927 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-82600c58-98d9-4efa-b23c-e856dcec3f6b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:46.815131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-82600c58-98d9-4efa-b23c-e856dcec3f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:46.830866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.907988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 212/422] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:46.909950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1683-a3a7-47a8-89e0-1190bec7ce3f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.910302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1683-a3a7-47a8-89e0-1190bec7ce3f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.910587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c1683-a3a7-47a8-89e0-1190bec7ce3f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.912367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 213/423] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:46.913212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ecc8d-cd5d-4e08-b292-a002697d5fc7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.917724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c738-026d-498b-a6c8-d3007e2965c1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.918031 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c738-026d-498b-a6c8-d3007e2965c1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.918304 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8c738-026d-498b-a6c8-d3007e2965c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.946929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4cc8c738-026d-498b-a6c8-d3007e2965c1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:46.949792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4cc8c738-026d-498b-a6c8-d3007e2965c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:46.959537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af26abf-c758-4f0a-95df-ee82de3b0695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.960170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26abf-c758-4f0a-95df-ee82de3b0695 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.960450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26abf-c758-4f0a-95df-ee82de3b0695 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.960784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26abf-c758-4f0a-95df-ee82de3b0695 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.961933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af26abf-c758-4f0a-95df-ee82de3b0695 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.963380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af26abf-c758-4f0a-95df-ee82de3b0695 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.965472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 211/424] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:46.970845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af26abf-c758-4f0a-95df-ee82de3b0695 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.027786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 214/425] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:47.113313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.116904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af26abf-c758-4f0a-95df-ee82de3b0695 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.175580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f28405-5db3-4696-a529-a5425221d230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.176135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f28405-5db3-4696-a529-a5425221d230 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.176415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f28405-5db3-4696-a529-a5425221d230 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.176691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f28405-5db3-4696-a529-a5425221d230 None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.177813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f28405-5db3-4696-a529-a5425221d230 None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.179311 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f28405-5db3-4696-a529-a5425221d230 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.181222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 212/426] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:47.187585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8c738-026d-498b-a6c8-d3007e2965c1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.247499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.262564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f28405-5db3-4696-a529-a5425221d230 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.372630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8c738-026d-498b-a6c8-d3007e2965c1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.425226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.425871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.426101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.426388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.427186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] RBAC: Adding query filter params (group.id=ad87a11a716844d3a3deb4b3940273eb, role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=60e78e00233e4cec80710a489bd078ea) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:47.427508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.429089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.432528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f28405-5db3-4696-a529-a5425221d230 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.436562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 215/427] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/role_assignments?group.id=ad87a11a716844d3a3deb4b3940273eb&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:47.437539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.476565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1e67-ac27-4f4d-91bd-628087c62b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.478162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1e67-ac27-4f4d-91bd-628087c62b80 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.478707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1e67-ac27-4f4d-91bd-628087c62b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.479189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1e67-ac27-4f4d-91bd-628087c62b80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.491927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d1e67-ac27-4f4d-91bd-628087c62b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-5b7d1e67-ac27-4f4d-91bd-628087c62b80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:47.498445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:47.499405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:47.500191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:47.502971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 213/428] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:47.512000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1e67-ac27-4f4d-91bd-628087c62b80 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.570269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.616446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.624289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c552c0-b3a2-40d3-b93e-493ffe85b567 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.666013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868a04-d296-4e40-83d6-bcd9080d302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.666759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868a04-d296-4e40-83d6-bcd9080d302c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.667039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868a04-d296-4e40-83d6-bcd9080d302c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.667552 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868a04-d296-4e40-83d6-bcd9080d302c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.674321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1e67-ac27-4f4d-91bd-628087c62b80 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.681384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97868a04-d296-4e40-83d6-bcd9080d302c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-97868a04-d296-4e40-83d6-bcd9080d302c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:47.688894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:47.689798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:47.690635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 216/429] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:47.698339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868a04-d296-4e40-83d6-bcd9080d302c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.729026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.730912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.731198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.731480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.732163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] RBAC: Adding query filter params (name=member) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:47.732761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.734561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.747919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 214/430] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:47.753593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.833515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868a04-d296-4e40-83d6-bcd9080d302c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.871796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.873617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.875037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.875037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.875037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.875472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:47.875744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.877131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.884804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34666d-c1e6-43e6-b67d-ec0837f63f57 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.886346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 217/431] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:47.895214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.916702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.921642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d0c9-3722-4595-a71c-abc6f6ae1921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.922297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d0c9-3722-4595-a71c-abc6f6ae1921 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.922577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d0c9-3722-4595-a71c-abc6f6ae1921 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.922850 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d0c9-3722-4595-a71c-abc6f6ae1921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.998275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37d0c9-3722-4595-a71c-abc6f6ae1921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.999778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37d0c9-3722-4595-a71c-abc6f6ae1921 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.019530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b6ca-9e24-41c2-9b63-cc412c41738b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.057141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade07dde-bd2f-456e-92b6-97167a5735d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.057753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade07dde-bd2f-456e-92b6-97167a5735d2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.058663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade07dde-bd2f-456e-92b6-97167a5735d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.058950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade07dde-bd2f-456e-92b6-97167a5735d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.088773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.110370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 215/432] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:48.112007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecc3af-249f-4921-b697-dbbf76bddaf6 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.112296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecc3af-249f-4921-b697-dbbf76bddaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.112574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecc3af-249f-4921-b697-dbbf76bddaf6 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.113875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 216/433] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:48.115070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecc3af-249f-4921-b697-dbbf76bddaf6 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.135150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade07dde-bd2f-456e-92b6-97167a5735d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.136709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade07dde-bd2f-456e-92b6-97167a5735d2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.154944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.241783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecc3af-249f-4921-b697-dbbf76bddaf6 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.247218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 218/434] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:26:48.252969 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d61871-ba48-47e1-aebc-402122bee83c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.253186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d61871-ba48-47e1-aebc-402122bee83c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.253747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d61871-ba48-47e1-aebc-402122bee83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.271351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-17d61871-ba48-47e1-aebc-402122bee83c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:48.273201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-17d61871-ba48-47e1-aebc-402122bee83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:48.281429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50201521-c16a-47ba-923a-2f0c47cc4c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.282519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50201521-c16a-47ba-923a-2f0c47cc4c11 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.282804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50201521-c16a-47ba-923a-2f0c47cc4c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.283077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50201521-c16a-47ba-923a-2f0c47cc4c11 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.284543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50201521-c16a-47ba-923a-2f0c47cc4c11 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.286352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50201521-c16a-47ba-923a-2f0c47cc4c11 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.288169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 217/435] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.288730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50201521-c16a-47ba-923a-2f0c47cc4c11 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.351017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 219/436] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:48.351854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d61871-ba48-47e1-aebc-402122bee83c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.352900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.398082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50201521-c16a-47ba-923a-2f0c47cc4c11 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.414231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.434859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daa11a-36bb-427f-a48e-9d41a7509f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.435615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa11a-36bb-427f-a48e-9d41a7509f51 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.435911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa11a-36bb-427f-a48e-9d41a7509f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.436187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa11a-36bb-427f-a48e-9d41a7509f51 None admin] PATH_INFO: `/v3/projects/60e78e00233e4cec80710a489bd078ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.437329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daa11a-36bb-427f-a48e-9d41a7509f51 None admin] RBAC: Authorizing `identity:get_project(project_id=60e78e00233e4cec80710a489bd078ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.438816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daa11a-36bb-427f-a48e-9d41a7509f51 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.440692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 218/437] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/projects/60e78e00233e4cec80710a489bd078ea => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.446196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c46cf-9892-4841-841f-3d42adc2aefc None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.446514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c46cf-9892-4841-841f-3d42adc2aefc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.446797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c46cf-9892-4841-841f-3d42adc2aefc None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.448182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 219/438] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:48.448829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c46cf-9892-4841-841f-3d42adc2aefc None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.473569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d61871-ba48-47e1-aebc-402122bee83c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.513476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f864938-9b2b-41ac-a588-0e34e8b49688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.514060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f864938-9b2b-41ac-a588-0e34e8b49688 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.514343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f864938-9b2b-41ac-a588-0e34e8b49688 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.514620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f864938-9b2b-41ac-a588-0e34e8b49688 None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.515726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f864938-9b2b-41ac-a588-0e34e8b49688 None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.517199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f864938-9b2b-41ac-a588-0e34e8b49688 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.523802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 220/439] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.523802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139faec-756c-410f-9917-df548ab0be77 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.523802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139faec-756c-410f-9917-df548ab0be77 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.523802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139faec-756c-410f-9917-df548ab0be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.538709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b139faec-756c-410f-9917-df548ab0be77 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:48.539909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b139faec-756c-410f-9917-df548ab0be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:48.569881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c46cf-9892-4841-841f-3d42adc2aefc None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.595825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.608419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445fe3a-9443-4c7f-9e7f-00a52076cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.609056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fe3a-9443-4c7f-9e7f-00a52076cf94 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.609337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fe3a-9443-4c7f-9e7f-00a52076cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.609611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fe3a-9443-4c7f-9e7f-00a52076cf94 None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.610390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 221/440] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:48.610967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139faec-756c-410f-9917-df548ab0be77 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.618652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445fe3a-9443-4c7f-9e7f-00a52076cf94 None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.622358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445fe3a-9443-4c7f-9e7f-00a52076cf94 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.624972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 220/441] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.630564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445fe3a-9443-4c7f-9e7f-00a52076cf94 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.664626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.722671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139faec-756c-410f-9917-df548ab0be77 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.740205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445fe3a-9443-4c7f-9e7f-00a52076cf94 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.764157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.764865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.765146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.765533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.766300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] RBAC: Adding query filter params (group.id=ad87a11a716844d3a3deb4b3940273eb, role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=c6a772c0c77e453aab85badccdb10dc0) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:48.766611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.768146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.774689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 222/442] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/role_assignments?group.id=ad87a11a716844d3a3deb4b3940273eb&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=a92b62fe43214de0b1468165da0d5456 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.775385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.781176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c755-5829-4b98-bb13-60cb52fda560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.782210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c755-5829-4b98-bb13-60cb52fda560 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.782807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c755-5829-4b98-bb13-60cb52fda560 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.783280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c755-5829-4b98-bb13-60cb52fda560 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.799778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199c755-5829-4b98-bb13-60cb52fda560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-4199c755-5829-4b98-bb13-60cb52fda560 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:48.806807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:48.807785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:48.809241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:48.812734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 221/443] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:48.821973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c755-5829-4b98-bb13-60cb52fda560 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.894106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.919791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24604a3b-9de5-4493-b509-215906d73d92 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.931540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.948243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c755-5829-4b98-bb13-60cb52fda560 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.964080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.964758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.965247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.965542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.966748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] RBAC: Adding query filter params (group.id=ad87a11a716844d3a3deb4b3940273eb, role.id=a92b62fe43214de0b1468165da0d5456, scope.project.id=60e78e00233e4cec80710a489bd078ea) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:48.967062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.968924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.975255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 223/444] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/role_assignments?group.id=ad87a11a716844d3a3deb4b3940273eb&scope.project.id=60e78e00233e4cec80710a489bd078ea&role.id=a92b62fe43214de0b1468165da0d5456 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.975911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.991161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.991994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.992276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.992550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.993434 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:48.993948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.995365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:49.014072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 222/445] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:49.020044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:49.107729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89837248-c543-4b0a-b92b-3879b97e1d10 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:49.135178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63426975-8b1e-45a6-910c-68ab946ac4bc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:49.148955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:49.152522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0d2db-535e-4d55-abc1-b85e76eb52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:49.153511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0d2db-535e-4d55-abc1-b85e76eb52a4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:49.153718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0d2db-535e-4d55-abc1-b85e76eb52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:49.154151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0d2db-535e-4d55-abc1-b85e76eb52a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:49.168796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0d2db-535e-4d55-abc1-b85e76eb52a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:49.172075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c96d5-02ae-4463-87b5-99919946285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:49.172683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c96d5-02ae-4463-87b5-99919946285e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:49.172963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c96d5-02ae-4463-87b5-99919946285e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:49.173233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c96d5-02ae-4463-87b5-99919946285e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-77e0d2db-535e-4d55-abc1-b85e76eb52a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:49.174129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:49.174993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:49.175800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 224/446] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:49.181312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0d2db-535e-4d55-abc1-b85e76eb52a4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:49.221425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:49.259753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c96d5-02ae-4463-87b5-99919946285e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:49.261212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c96d5-02ae-4463-87b5-99919946285e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:49.300774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0d2db-535e-4d55-abc1-b85e76eb52a4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:49.346225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:49.347071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:49.347359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:49.348431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:49.349113 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:49.349420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:49.350890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:49.361433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 225/447] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:49.367209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:49.394337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 223/448] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:26:49.400681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c96d5-02ae-4463-87b5-99919946285e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:49.418944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:49.497102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:49.504774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e562e-0324-4b35-b44c-f418d320117c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:49.531823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c96d5-02ae-4463-87b5-99919946285e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:49.551081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e173-c27c-47bd-b662-a8121b9cf47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:49.551766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e173-c27c-47bd-b662-a8121b9cf47f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:49.552052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e173-c27c-47bd-b662-a8121b9cf47f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:49.552327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238e173-c27c-47bd-b662-a8121b9cf47f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:49.581091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8fde-145e-461c-a6f9-6cace0e74a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:49.581908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8fde-145e-461c-a6f9-6cace0e74a60 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:49.582227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8fde-145e-461c-a6f9-6cace0e74a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:49.582487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a8fde-145e-461c-a6f9-6cace0e74a60 None admin] PATH_INFO: `/v3/projects/c6a772c0c77e453aab85badccdb10dc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:49.583977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8fde-145e-461c-a6f9-6cace0e74a60 None admin] RBAC: Authorizing `identity:get_project(project_id=c6a772c0c77e453aab85badccdb10dc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:49.585432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a8fde-145e-461c-a6f9-6cace0e74a60 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:49.587266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 224/449] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:49 2022] GET /identity/v3/projects/c6a772c0c77e453aab85badccdb10dc0 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:49.593663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8fde-145e-461c-a6f9-6cace0e74a60 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:49.644580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238e173-c27c-47bd-b662-a8121b9cf47f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:49.646080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238e173-c27c-47bd-b662-a8121b9cf47f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:49.690157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:49.709411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a8fde-145e-461c-a6f9-6cace0e74a60 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:49.743464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0956e3-d2b8-4faa-a3c3-7dbaf4265798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:49.744089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956e3-d2b8-4faa-a3c3-7dbaf4265798 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:49.744370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956e3-d2b8-4faa-a3c3-7dbaf4265798 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:49.744646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956e3-d2b8-4faa-a3c3-7dbaf4265798 None admin] PATH_INFO: `/v3/groups/ad87a11a716844d3a3deb4b3940273eb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:49.746450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0956e3-d2b8-4faa-a3c3-7dbaf4265798 None admin] RBAC: Authorizing `identity:get_group(group_id=ad87a11a716844d3a3deb4b3940273eb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:49.748139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0956e3-d2b8-4faa-a3c3-7dbaf4265798 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:49.749884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 225/450] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:49 2022] GET /identity/v3/groups/ad87a11a716844d3a3deb4b3940273eb => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:49.752578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:49.756640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0956e3-d2b8-4faa-a3c3-7dbaf4265798 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:49.759817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 226/451] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:26:49.765419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e173-c27c-47bd-b662-a8121b9cf47f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:49.856822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0956e3-d2b8-4faa-a3c3-7dbaf4265798 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:49.862811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238e173-c27c-47bd-b662-a8121b9cf47f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:49.891098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:49.891686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:49.891961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:49.892227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:49.892939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] RBAC: Adding query filter params (group.id=ad87a11a716844d3a3deb4b3940273eb, role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=c6a772c0c77e453aab85badccdb10dc0) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:49.893240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:49.894722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:49.896096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8bea2-a442-43f3-bd62-e8aff261149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:49.896727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bea2-a442-43f3-bd62-e8aff261149a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:49.897007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bea2-a442-43f3-bd62-e8aff261149a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:49.897279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bea2-a442-43f3-bd62-e8aff261149a None admin] PATH_INFO: `/v3/projects/e63b0c3551a8436a97c9341435afc499` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:49.898431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8bea2-a442-43f3-bd62-e8aff261149a None admin] RBAC: Authorizing `identity:get_project(project_id=e63b0c3551a8436a97c9341435afc499)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:49.899852 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8bea2-a442-43f3-bd62-e8aff261149a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:49.900518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 226/452] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:49 2022] GET /identity/v3/role_assignments?group.id=ad87a11a716844d3a3deb4b3940273eb&scope.project.id=c6a772c0c77e453aab85badccdb10dc0&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:49.901690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 227/453] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:49 2022] GET /identity/v3/projects/e63b0c3551a8436a97c9341435afc499 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:49.907768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:49.925144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:50.016486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5c6f8-8b12-4604-a6ec-8ec88e7300f1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:50.051546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b93d2-5254-4551-949a-4c3baa708212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:50.052187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b93d2-5254-4551-949a-4c3baa708212 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:50.052473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b93d2-5254-4551-949a-4c3baa708212 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:50.052749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b93d2-5254-4551-949a-4c3baa708212 None admin] PATH_INFO: `/v3/groups/3bbe3c1a66d04b8f8dedb675662cb1fd` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:50.053913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b93d2-5254-4551-949a-4c3baa708212 None admin] RBAC: Authorizing `identity:get_group(group_id=3bbe3c1a66d04b8f8dedb675662cb1fd)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:50.055388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b93d2-5254-4551-949a-4c3baa708212 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:50.056965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 227/454] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:49 2022] GET /identity/v3/groups/3bbe3c1a66d04b8f8dedb675662cb1fd => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:50.063442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8bea2-a442-43f3-bd62-e8aff261149a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:50.134886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:50.176043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8bea2-a442-43f3-bd62-e8aff261149a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:50.209389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9141e-6a85-421c-8a1f-ce1bd27182a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:50.210027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9141e-6a85-421c-8a1f-ce1bd27182a0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:50.210310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9141e-6a85-421c-8a1f-ce1bd27182a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:50.210600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9141e-6a85-421c-8a1f-ce1bd27182a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:50.211310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9141e-6a85-421c-8a1f-ce1bd27182a0 None admin] RBAC: Adding query filter params (group.id=3bbe3c1a66d04b8f8dedb675662cb1fd, role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=e63b0c3551a8436a97c9341435afc499) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:50.211613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9141e-6a85-421c-8a1f-ce1bd27182a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:50.213040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9141e-6a85-421c-8a1f-ce1bd27182a0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:50.219674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 228/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:50 2022] GET /identity/v3/role_assignments?group.id=3bbe3c1a66d04b8f8dedb675662cb1fd&scope.project.id=e63b0c3551a8436a97c9341435afc499&role.id=cac8d7ae8325488684667d62304b0860 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:52.630807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42add5-ae20-4358-85f4-2cdbb779e821 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.631821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42add5-ae20-4358-85f4-2cdbb779e821 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.632312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42add5-ae20-4358-85f4-2cdbb779e821 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.634161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 228/456] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:52.640121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725602-352b-41be-a62c-a793ed33c3e0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.640955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725602-352b-41be-a62c-a793ed33c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.641440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725602-352b-41be-a62c-a793ed33c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.666876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-19725602-352b-41be-a62c-a793ed33c3e0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:52.668862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-19725602-352b-41be-a62c-a793ed33c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:52.707161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1690-c187-4325-959d-034a46e41536 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.707766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1690-c187-4325-959d-034a46e41536 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.708296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1690-c187-4325-959d-034a46e41536 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.710283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 229/457] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:52.716513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13751eb-4393-4cb6-8d7d-0a3d83b544c4 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.717043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13751eb-4393-4cb6-8d7d-0a3d83b544c4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.717521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13751eb-4393-4cb6-8d7d-0a3d83b544c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.762949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-f13751eb-4393-4cb6-8d7d-0a3d83b544c4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:52.764168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f13751eb-4393-4cb6-8d7d-0a3d83b544c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:52.765975 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 229/458] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:52.876557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 230/459] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:52.965330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e730e9-7017-4f99-97e9-51c46d7a28d6 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.965656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e730e9-7017-4f99-97e9-51c46d7a28d6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.965856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e730e9-7017-4f99-97e9-51c46d7a28d6 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.967507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 230/460] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:52.972428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127d4c-8056-4d95-a18d-43d55e71375a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.972726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127d4c-8056-4d95-a18d-43d55e71375a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.973010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0127d4c-8056-4d95-a18d-43d55e71375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.992447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b0127d4c-8056-4d95-a18d-43d55e71375a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:52.993647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b0127d4c-8056-4d95-a18d-43d55e71375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:53.002314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.086089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 231/461] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:53.113095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e730e9-7017-4f99-97e9-51c46d7a28d6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.208413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.265627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e730e9-7017-4f99-97e9-51c46d7a28d6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.282168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0127d4c-8056-4d95-a18d-43d55e71375a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.312212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.312841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.313121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.313391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.328361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.329827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:53.346229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:53.347164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:53.348027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:53.348027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:53.348027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:53.348027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 231/462] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:53.354374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.478340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fbe18-97b7-4f70-a9f0-45f0c2a273a1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.478915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0127d4c-8056-4d95-a18d-43d55e71375a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.492355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.519430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.519979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.520259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.520529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.523859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.524714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.525192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.525677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.526674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:53.527687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.530363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.531986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.533711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.535690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:53.555365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:53.556377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:53.557264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:53.557264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:53.557264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:53.557425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 232/463] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:53.558018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.560487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 232/464] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:53.565498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.674373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b51f1-331f-4e59-85d0-a78d1cea3ad5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.675556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c48f18-0bec-4a6c-95e9-6ee1226ebbcd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.710331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea1268-2ef4-47a8-bb01-99e5e7ab7eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.710704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.710968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1268-2ef4-47a8-bb01-99e5e7ab7eab None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.711251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1268-2ef4-47a8-bb01-99e5e7ab7eab None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.711526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1268-2ef4-47a8-bb01-99e5e7ab7eab None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.712165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea1268-2ef4-47a8-bb01-99e5e7ab7eab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.713031 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.713618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea1268-2ef4-47a8-bb01-99e5e7ab7eab None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.713817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.714862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.728314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.730376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.741536 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 233/465] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:53 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:53.743051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a840d-818b-4045-93b6-247b949be334 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.743546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a840d-818b-4045-93b6-247b949be334 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.743986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a840d-818b-4045-93b6-247b949be334 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.745621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 234/466] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:53.750093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:53.750971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:53.751832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:53.751832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:53.751832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:53.751832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 233/467] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:53.751832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.755077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07b9b-d09a-4014-95b3-8a598264a32f None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.755363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07b9b-d09a-4014-95b3-8a598264a32f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.755634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07b9b-d09a-4014-95b3-8a598264a32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.779276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c0e07b9b-d09a-4014-95b3-8a598264a32f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:53.780405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c0e07b9b-d09a-4014-95b3-8a598264a32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:53.785421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.859528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.883532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea7559-2ee4-4e48-95c7-fd10e10be0de None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.892267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 235/468] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:53.898083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e07b9b-d09a-4014-95b3-8a598264a32f None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.961082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.962376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.962727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.963070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.963779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:53.964238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.966688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.984510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 234/469] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:53.991007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:54.025014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e07b9b-d09a-4014-95b3-8a598264a32f None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:54.066619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:54.067149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.067428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.067701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.068348 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:54.068649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:54.070084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:54.085179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 236/470] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:54.094947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:54.099110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:54.124335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962c62a-02e6-4a34-a22c-91e22365ea1c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:54.155774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:54.169534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425999d-ad4a-4207-8228-4ec9f01f5f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:54.170781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425999d-ad4a-4207-8228-4ec9f01f5f2f None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.171648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425999d-ad4a-4207-8228-4ec9f01f5f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.172121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425999d-ad4a-4207-8228-4ec9f01f5f2f None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.172968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425999d-ad4a-4207-8228-4ec9f01f5f2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:54.175207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425999d-ad4a-4207-8228-4ec9f01f5f2f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:54.207083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 235/471] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:53 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:54.209050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d3f01-f9d1-4636-8a61-61e960340b0a None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.210084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d3f01-f9d1-4636-8a61-61e960340b0a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.210584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d3f01-f9d1-4636-8a61-61e960340b0a None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.212423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 236/472] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:54.213647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d3f01-f9d1-4636-8a61-61e960340b0a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:54.237628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a51542-17cc-4f2b-bf4b-f0eb09d8b02d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:54.279050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02628b-1027-48fc-ae98-c52499efd584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:54.279676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02628b-1027-48fc-ae98-c52499efd584 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.279957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02628b-1027-48fc-ae98-c52499efd584 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.280229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02628b-1027-48fc-ae98-c52499efd584 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.281023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02628b-1027-48fc-ae98-c52499efd584 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:54.282520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02628b-1027-48fc-ae98-c52499efd584 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:54.317956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 237/473] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:54 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:54.317956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840393-c2cc-47ea-94da-69db446079c0 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.317956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840393-c2cc-47ea-94da-69db446079c0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.317956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840393-c2cc-47ea-94da-69db446079c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.335326 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-12840393-c2cc-47ea-94da-69db446079c0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:54.336794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-12840393-c2cc-47ea-94da-69db446079c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:54.379516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d3f01-f9d1-4636-8a61-61e960340b0a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:54.431808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:54.432506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.433334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.433787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.437987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 238/474] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:54.443436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:54.448493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:54.451465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:54.468267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:54.469238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:54.470129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:54.470129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:54.470129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:54.470129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 237/475] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:54.475537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12840393-c2cc-47ea-94da-69db446079c0 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:54.507167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:54.587376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12840393-c2cc-47ea-94da-69db446079c0 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:54.623927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:54.624594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.624882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.625155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.625803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:54.626129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:54.627516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:54.646202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 239/476] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:54.647739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:54.734729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:54.757166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce66ea-2370-4e43-a4d9-ccff12c652a9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:54.792981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9a20-4599-4c52-944f-46689ebe7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:54.793593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9a20-4599-4c52-944f-46689ebe7d50 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.793892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9a20-4599-4c52-944f-46689ebe7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.794168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9a20-4599-4c52-944f-46689ebe7d50 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.794824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e9a20-4599-4c52-944f-46689ebe7d50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:54.796340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e9a20-4599-4c52-944f-46689ebe7d50 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:54.824040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 238/477] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:54 2022] POST /identity/v3/users => generated 249 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:54.857098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:54.869382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b740bf-4148-4c14-962e-fe791c6ceae4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:54.919616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:54.920295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.920576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.920847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.921531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:54.923094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:54.935210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.sql.core [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 15:26:54.935210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 15:26:54.935210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [parameters: {'id': '4f26f98f6e384534a562beebcc6b45b4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 15:26:54.935210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81828) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application result.read() Aug 26 15:26:54.961495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return ref.to_dict() Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:26:54.962480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application yield resource Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise self.value Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application session.commit() Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 15:26:54.963388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.session.flush() Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application compat.raise_( Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 15:26:54.964946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:26:54.965826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application result.read() Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:26:54.968480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [parameters: {'id': '4f26f98f6e384534a562beebcc6b45b4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:54.978933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 15:26:54.980970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:54.982955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 240/478] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 15:26:54 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:54.983090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9a20-4599-4c52-944f-46689ebe7d50 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:55.025708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:55.084729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9a20-4599-4c52-944f-46689ebe7d50 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:55.121962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7827c-d4c9-4e5a-bf68-b22629e419bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:55.122538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7827c-d4c9-4e5a-bf68-b22629e419bb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.122821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7827c-d4c9-4e5a-bf68-b22629e419bb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.123154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7827c-d4c9-4e5a-bf68-b22629e419bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.134774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7827c-d4c9-4e5a-bf68-b22629e419bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-30e7827c-d4c9-4e5a-bf68-b22629e419bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:55.140524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:55.141422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:55.142442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 239/479] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:55.149969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:55.265425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1901c-0908-437d-ae02-0991eed98de0 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:55.307944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df292a3-92d2-4746-b878-a93d9741b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:55.308941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df292a3-92d2-4746-b878-a93d9741b275 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.309479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df292a3-92d2-4746-b878-a93d9741b275 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.310011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df292a3-92d2-4746-b878-a93d9741b275 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.310892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df292a3-92d2-4746-b878-a93d9741b275 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:55.311421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df292a3-92d2-4746-b878-a93d9741b275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:55.313010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df292a3-92d2-4746-b878-a93d9741b275 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:55.329949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 241/480] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:56.348473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d47c66-dab2-4894-9370-2fadec1da202 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.349018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d47c66-dab2-4894-9370-2fadec1da202 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.349018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d47c66-dab2-4894-9370-2fadec1da202 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.350677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 240/481] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:56.356494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aa5c1-8872-48cf-b685-f65f304a98fa None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.357372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aa5c1-8872-48cf-b685-f65f304a98fa None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.357902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aa5c1-8872-48cf-b685-f65f304a98fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.387580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-2d4aa5c1-8872-48cf-b685-f65f304a98fa None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:56.389130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2d4aa5c1-8872-48cf-b685-f65f304a98fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:56.397819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.481020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 242/482] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:56.615087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3ae57-9541-43a4-9a7d-b15944ac2516 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.615427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3ae57-9541-43a4-9a7d-b15944ac2516 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.615645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3ae57-9541-43a4-9a7d-b15944ac2516 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.617302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 241/483] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:56.623081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9167de-ca28-43c4-9b81-9687f8e16aa4 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.623616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9167de-ca28-43c4-9b81-9687f8e16aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.624180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9167de-ca28-43c4-9b81-9687f8e16aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.648583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4b9167de-ca28-43c4-9b81-9687f8e16aa4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:56.649688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4b9167de-ca28-43c4-9b81-9687f8e16aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:56.748382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 243/484] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:56.776364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3ae57-9541-43a4-9a7d-b15944ac2516 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.822845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66665-0f6b-4b90-b6b4-efd2899d607b None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.823161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66665-0f6b-4b90-b6b4-efd2899d607b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.823439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66665-0f6b-4b90-b6b4-efd2899d607b None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.825268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 244/485] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:56.837157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5102f4-63b2-4b4d-80d2-ca8d222a569a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.842545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5102f4-63b2-4b4d-80d2-ca8d222a569a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.843061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5102f4-63b2-4b4d-80d2-ca8d222a569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.874613 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-fc5102f4-63b2-4b4d-80d2-ca8d222a569a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:56.877448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fc5102f4-63b2-4b4d-80d2-ca8d222a569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:56.959195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 245/486] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:56.971472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3ae57-9541-43a4-9a7d-b15944ac2516 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.979550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.014168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77c8ef-e5dc-4e16-9e5f-1161f3cac797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.015157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77c8ef-e5dc-4e16-9e5f-1161f3cac797 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.015641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77c8ef-e5dc-4e16-9e5f-1161f3cac797 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.016135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77c8ef-e5dc-4e16-9e5f-1161f3cac797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.027640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77c8ef-e5dc-4e16-9e5f-1161f3cac797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-ba77c8ef-e5dc-4e16-9e5f-1161f3cac797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:57.032837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.033708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:57.034557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:57.037143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 242/487] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.042741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5102f4-63b2-4b4d-80d2-ca8d222a569a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.045577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.049615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77c8ef-e5dc-4e16-9e5f-1161f3cac797 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.188040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5102f4-63b2-4b4d-80d2-ca8d222a569a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.231950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77c8ef-e5dc-4e16-9e5f-1161f3cac797 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.256352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.256974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.257255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.257527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.258348 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] RBAC: Adding query filter params (name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.258656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.260148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.271646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63e7f-2c78-4138-8b49-b783e908b52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.272479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63e7f-2c78-4138-8b49-b783e908b52a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.272953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63e7f-2c78-4138-8b49-b783e908b52a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.273451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be63e7f-2c78-4138-8b49-b783e908b52a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.284097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 246/488] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.285763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be63e7f-2c78-4138-8b49-b783e908b52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:57.288065 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2be63e7f-2c78-4138-8b49-b783e908b52a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:57.291132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.292385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:57.293557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 243/489] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.294838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63e7f-2c78-4138-8b49-b783e908b52a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.334774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.363604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.405756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738323f8-4de8-470a-ab9f-975c95bbcffc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.437866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be63e7f-2c78-4138-8b49-b783e908b52a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.443246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb10f2-b371-44bb-96fa-9f63be3bcb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.443980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb10f2-b371-44bb-96fa-9f63be3bcb0b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.444361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb10f2-b371-44bb-96fa-9f63be3bcb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.444734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb10f2-b371-44bb-96fa-9f63be3bcb0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.456794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb10f2-b371-44bb-96fa-9f63be3bcb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b6eb10f2-b371-44bb-96fa-9f63be3bcb0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:57.462138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.463247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:57.464447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:57.466666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 247/490] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.467638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb10f2-b371-44bb-96fa-9f63be3bcb0b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.484954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.486584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.487277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.487720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.502785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.505152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:57.525506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.526947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:57.528073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:57.528073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:57.528073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:57.530034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 244/491] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.531209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.586856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb10f2-b371-44bb-96fa-9f63be3bcb0b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.622627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.636809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.643559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.644683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.645545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.646071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.646947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] RBAC: Adding query filter params (name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.647532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.649971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.662306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e880b1-bc5d-48b8-a9c7-dbc77d8237a5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.663256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 248/492] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.668504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.700068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcb577-afa4-4e74-9485-dd755af3d165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.700806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcb577-afa4-4e74-9485-dd755af3d165 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.701308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcb577-afa4-4e74-9485-dd755af3d165 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.701684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcb577-afa4-4e74-9485-dd755af3d165 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.702393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcb577-afa4-4e74-9485-dd755af3d165 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.702701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcb577-afa4-4e74-9485-dd755af3d165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.704085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcb577-afa4-4e74-9485-dd755af3d165 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.717052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 245/493] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.718310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c91cd-d485-410e-beb8-41fc4abbb8b3 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.718610 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c91cd-d485-410e-beb8-41fc4abbb8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.718886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c91cd-d485-410e-beb8-41fc4abbb8b3 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.720124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 246/494] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:57.722085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c91cd-d485-410e-beb8-41fc4abbb8b3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.777824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74f6b-c060-489d-9d89-09269c63d648 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.813586 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.814229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.814503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.814782 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.815424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.815725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.817129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.829223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 249/495] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.830071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.839697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c91cd-d485-410e-beb8-41fc4abbb8b3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.877197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267f96a-37e4-4939-8f0d-a633515a1286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.877971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f96a-37e4-4939-8f0d-a633515a1286 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.878251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f96a-37e4-4939-8f0d-a633515a1286 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.878546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f96a-37e4-4939-8f0d-a633515a1286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.881163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.890048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.892718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f96a-37e4-4939-8f0d-a633515a1286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.894606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f96a-37e4-4939-8f0d-a633515a1286 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8267f96a-37e4-4939-8f0d-a633515a1286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:57.910105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.911181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:57.912273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:57.912273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:57.912273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:57.913682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 247/496] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.915015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d8f7-5a6e-4046-8030-1cf2439d221c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.915451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d8f7-5a6e-4046-8030-1cf2439d221c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.915865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d8f7-5a6e-4046-8030-1cf2439d221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.937355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-75c2d8f7-5a6e-4046-8030-1cf2439d221c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:57.938580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75c2d8f7-5a6e-4046-8030-1cf2439d221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:57.946300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc03da-2741-437b-9a3e-24168714814b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.982416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.983098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.983385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.983657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.995860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.998228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:58.014139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.020408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:58.021255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:58.021255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:58.021255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:58.021429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 248/497] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:58.021429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2d8f7-5a6e-4046-8030-1cf2439d221c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.021553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 250/498] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.021553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.130530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.134855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2d8f7-5a6e-4046-8030-1cf2439d221c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.136646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf98187-51fd-42d5-ae45-c9ed0398ef65 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.159258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.173002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469af27f-e4bc-4ec5-a098-5195119663ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.173422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.173633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469af27f-e4bc-4ec5-a098-5195119663ca None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.173953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469af27f-e4bc-4ec5-a098-5195119663ca None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.174050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.174236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469af27f-e4bc-4ec5-a098-5195119663ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.174340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.174585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.175226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.175528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.177247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.181644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469af27f-e4bc-4ec5-a098-5195119663ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.183212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469af27f-e4bc-4ec5-a098-5195119663ca None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.193286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 251/499] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.193286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-469af27f-e4bc-4ec5-a098-5195119663ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:26:58.201098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.202093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:58.203029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 249/500] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.204574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170ebb4-d698-48a8-ada8-462a26494c3c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.204872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170ebb4-d698-48a8-ada8-462a26494c3c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.205123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170ebb4-d698-48a8-ada8-462a26494c3c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.210529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 250/501] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:58.210529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170ebb4-d698-48a8-ada8-462a26494c3c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.296339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e5ad-85dd-4fae-b03a-4c64d6197392 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.318851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170ebb4-d698-48a8-ada8-462a26494c3c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.332167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.332773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.333050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.333322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.333991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.334295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.335678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.347231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 252/502] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.352534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.352774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b82ec-ae81-4f2f-a06a-614763542ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.353404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b82ec-ae81-4f2f-a06a-614763542ddb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.353687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b82ec-ae81-4f2f-a06a-614763542ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.353995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b82ec-ae81-4f2f-a06a-614763542ddb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.362830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b82ec-ae81-4f2f-a06a-614763542ddb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.364266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b82ec-ae81-4f2f-a06a-614763542ddb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.372519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-137b82ec-ae81-4f2f-a06a-614763542ddb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:26:58.375193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.376184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 251/503] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8481d1-aea6-4cc8-b403-fa6e17758453 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.377985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8481d1-aea6-4cc8-b403-fa6e17758453 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.378671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8481d1-aea6-4cc8-b403-fa6e17758453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.396082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7b8481d1-aea6-4cc8-b403-fa6e17758453 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:58.397286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b8481d1-aea6-4cc8-b403-fa6e17758453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:58.433116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.457379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2fe12-b2ac-4def-996e-fde1a083b706 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.466211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 252/504] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:58.467113 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8481d1-aea6-4cc8-b403-fa6e17758453 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.494710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.495391 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.495663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.496167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.496646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.496950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.498437 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.545497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 253/505] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.546421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.584678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8481d1-aea6-4cc8-b403-fa6e17758453 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.619437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406615a-c11e-472d-8389-87d83e2a3902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.620061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406615a-c11e-472d-8389-87d83e2a3902 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.620480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406615a-c11e-472d-8389-87d83e2a3902 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.620763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406615a-c11e-472d-8389-87d83e2a3902 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.625484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.632294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406615a-c11e-472d-8389-87d83e2a3902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-0406615a-c11e-472d-8389-87d83e2a3902 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:58.637529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.638436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:58.639241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:58.643662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 253/506] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.644491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406615a-c11e-472d-8389-87d83e2a3902 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.654146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf5d8d-2759-45f9-924d-9032a874908b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.679700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.691594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.692287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.692564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.692842 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.700422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.701983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:26:58.715471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.716390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:58.717298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 254/507] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.717899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.761229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406615a-c11e-472d-8389-87d83e2a3902 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.794856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.795455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.795758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.796033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.796759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.797065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.798553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.824116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cde293-23b4-4e08-a6f4-d5b1fed29ebc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.834624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 254/508] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.835457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.862782 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524ef9-72f1-4fc2-b36c-2c34b12e2caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.863383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524ef9-72f1-4fc2-b36c-2c34b12e2caf None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.863666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524ef9-72f1-4fc2-b36c-2c34b12e2caf None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.863935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524ef9-72f1-4fc2-b36c-2c34b12e2caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.867235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.927309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.933631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2524ef9-72f1-4fc2-b36c-2c34b12e2caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.935149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2524ef9-72f1-4fc2-b36c-2c34b12e2caf None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.937075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46cd7c-1952-445d-8caf-7a57655fa985 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.970611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.971208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.971487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.971756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.972405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.972712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.974108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.982602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 255/509] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.983395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.038834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 255/510] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:59.039683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524ef9-72f1-4fc2-b36c-2c34b12e2caf None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.075013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.083033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dfc92-167b-4f02-b1a8-c3d7371dad25 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.117110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.117707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.118015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.118291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.119004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.119313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.120826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.138402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 256/511] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.139252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.143320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524ef9-72f1-4fc2-b36c-2c34b12e2caf None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.152978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.179623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.180295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.180707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.180986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.191257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.192747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:59.208132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:59.209135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:59.210059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:59.210059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.210059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:59.210059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 256/512] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:59.210059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.250585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece64448-56e9-4b4b-8725-0bc25adb225a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.286267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152fa27-61af-4d0f-8163-e3486b8f1dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.286867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152fa27-61af-4d0f-8163-e3486b8f1dbf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.287189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152fa27-61af-4d0f-8163-e3486b8f1dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.287492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152fa27-61af-4d0f-8163-e3486b8f1dbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.297979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.310188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b4e45-4551-4430-bfbf-53395d1533ab None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.343951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.344576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.344854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.345125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.353186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152fa27-61af-4d0f-8163-e3486b8f1dbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.355460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152fa27-61af-4d0f-8163-e3486b8f1dbf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.355963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.357399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.367884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:59.372696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:59.374154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:59.375050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:59.375050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.375050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:59.375050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 257/513] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:59.375050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.459709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 257/514] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:59.460548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152fa27-61af-4d0f-8163-e3486b8f1dbf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.476990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95743127-93f6-46d7-b4c5-b0423b7e4c2b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.511582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.512213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.512499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.512779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.521675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.523939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.525828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:59.540322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:59.541444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:59.543463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:59.543463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.543463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:26:59.543463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 258/515] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:59.543463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.562651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152fa27-61af-4d0f-8163-e3486b8f1dbf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.574242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.597812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a06a6-43b7-46ac-b330-10c43b205e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.598673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a06a6-43b7-46ac-b330-10c43b205e35 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.598951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a06a6-43b7-46ac-b330-10c43b205e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.599220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a06a6-43b7-46ac-b330-10c43b205e35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.642310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9129-286f-4135-9745-b920c002cf6b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.664936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a06a6-43b7-46ac-b330-10c43b205e35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.666611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a06a6-43b7-46ac-b330-10c43b205e35 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.675583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.676185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.676463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.676737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.677373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.677702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.679092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.691943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 259/516] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.692599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.746970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.773414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 258/517] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:59.774282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a06a6-43b7-46ac-b330-10c43b205e35 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.785177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.799926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c88312-a171-41ed-bf57-d1f6b29eb23e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.837479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.838113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.838394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.838667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.839445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.839892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.841293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.852651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 260/518] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.853446 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.879546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a06a6-43b7-46ac-b330-10c43b205e35 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.913624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.914278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.914559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.914832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.924977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.926472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:59.941176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:59.942367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:59.943198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:59.943198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.943198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:26:59.943198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 259/519] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:59.943198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.955986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010c58e-28ac-461c-8103-b77d4ed1a95d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.969099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.991161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.991758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.992034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.992304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.992934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.993231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.994697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.005412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.007295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 261/520] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:00.008199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.045048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413a42-746a-4f2a-a817-f64780df27e5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.078249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4d6e-2d65-4cfc-948b-aa3d00d3e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.078843 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4d6e-2d65-4cfc-948b-aa3d00d3e8c9 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.079120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4d6e-2d65-4cfc-948b-aa3d00d3e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.079386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4d6e-2d65-4cfc-948b-aa3d00d3e8c9 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.080006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df4d6e-2d65-4cfc-948b-aa3d00d3e8c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.081436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df4d6e-2d65-4cfc-948b-aa3d00d3e8c9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.105041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 260/521] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:59 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:00.114111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4d6e-2d65-4cfc-948b-aa3d00d3e8c9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.120871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c630d5d-a090-4951-b86d-dd0f3730f15c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.172727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.173612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.174050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.174471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.188153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.189852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:00.207159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:00.208151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:00.209013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:00.209013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:00.209013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:00.209013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 262/522] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:00.209239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.230650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4d6e-2d65-4cfc-948b-aa3d00d3e8c9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.239470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.251033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.276701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.277243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.277515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.277789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.285927 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.287373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:00.301383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:00.302559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:00.303477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:00.305910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 261/523] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:00.307190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.335821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9720d70-1de1-4116-9f7a-5cd4c5f58fde None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.373492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.374163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.374408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.374669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.375309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:00.375610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.376987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.389872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 263/524] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:00.390697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.420010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64138ec8-c06f-41a8-8104-72ef1bc2f813 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.456266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.457228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.457690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.458167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.465578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.467353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:00.479759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:00.480664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:00.481507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 262/525] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:00.482714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.488505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.507129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24614bad-6bc1-4560-bbb1-b1268a30c81e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.524891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.542716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.543244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.543523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.543792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.544415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:00.544723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.546116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.557238 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 264/526] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:00.559013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.595130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f5574-ea3d-4d10-89ab-214b76f15821 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.631770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.632381 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.632667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.632942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.633675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:00.634008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.635451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.654621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 263/527] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:00.655261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.666219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbc50-d533-4ebf-81bc-00d1182bbf78 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.701575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.702226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.702495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.702766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.709605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.711192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:00.723466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:00.724408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:00.725278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:00.725278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:00.725278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:00.725278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:00.725278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:00.725278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:00.725278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:00.725278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:00.729985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 265/528] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:00.730870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.735196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.758716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.767086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd321c5-7188-4697-a59f-464c700c9c52 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.804437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.804959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.805239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.805495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.806400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:00.806528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.808613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.831024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 264/529] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:00.831024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.842630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a4dba-84bd-4350-b1cf-3d1d81bf60f4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.878715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.879345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.879626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.879901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.886630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.888085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:00.899047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:00.900057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:00.901111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:00.901111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:00.901111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:00.901111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:00.901111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:00.901111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:00.901111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:00.901111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:00.904855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 266/530] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:00.905738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.939239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c94d9-435e-495f-883f-7b602085ab52 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.969816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.973757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c288a-89ab-4c05-a0cd-4d3696ba2e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.974391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c288a-89ab-4c05-a0cd-4d3696ba2e1b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.974677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c288a-89ab-4c05-a0cd-4d3696ba2e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.974949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c288a-89ab-4c05-a0cd-4d3696ba2e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.003946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.017692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bdde1-64d3-40d4-a555-edc8e47e3268 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.053564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c288a-89ab-4c05-a0cd-4d3696ba2e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.055195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c288a-89ab-4c05-a0cd-4d3696ba2e1b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.055545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.056299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.056649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.056994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.058501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.059636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.061141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.079216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 267/531] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.080097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.177901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 265/532] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:01.179146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c288a-89ab-4c05-a0cd-4d3696ba2e1b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.196100 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef2a2a-bf2d-4237-956a-86546bc02be2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.220409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.232924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.233551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.233866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.234146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.234901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=38af4d5f21ae43b699d7890ce9534d29) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.235214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.236997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.243166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 268/533] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/role_assignments?user.id=38af4d5f21ae43b699d7890ce9534d29&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.243994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.256461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.318178 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c288a-89ab-4c05-a0cd-4d3696ba2e1b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.368773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.369579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.370884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.371365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.372342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.372747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.375060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.380476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66e637-f2f3-482e-ac3d-c175dc2fa814 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.395325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 266/534] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.395325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.435881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.436631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.436977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.437320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.438154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=a0c16885de9e4e82bcbede361e548ec9) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.438527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.440196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.453884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 269/535] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/role_assignments?user.id=a0c16885de9e4e82bcbede361e548ec9&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.453884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.564302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a18f6-b0c8-4dc5-bdcb-13547da32040 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.577901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.584059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.606114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.606746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.607132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.607257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.631712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.633529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.658409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddaf32-bde9-4c1a-997d-130c22ba3f65 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:01.667942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:01.668907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:01.669766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:01.669766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:01.669766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:01.678112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 267/536] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:01.685179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.699966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.700960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.701387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.701906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.707888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=3adaa1462c8a4acdab7e631a795cd40f) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.708209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.709677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.728131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 270/537] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/role_assignments?user.id=3adaa1462c8a4acdab7e631a795cd40f&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.842809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94334e1-89d2-4e77-9109-d8ae3eec3c84 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.881057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.881681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.881999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.882276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.882934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.883239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.884664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.899772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 268/538] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.911259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.046574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8dfb8-cb13-4d6d-bcbf-670e34213c0b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.063579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.090055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54711412-cc9e-4cbe-84d7-6f6e9260bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.090837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54711412-cc9e-4cbe-84d7-6f6e9260bf7d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.091115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54711412-cc9e-4cbe-84d7-6f6e9260bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.091384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54711412-cc9e-4cbe-84d7-6f6e9260bf7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.098744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54711412-cc9e-4cbe-84d7-6f6e9260bf7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.100137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54711412-cc9e-4cbe-84d7-6f6e9260bf7d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-54711412-cc9e-4cbe-84d7-6f6e9260bf7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:02.121099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:02.122056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:02.124322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 271/539] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:02.134881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.184769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.186217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff14b-d32b-45ee-a926-9acb754cfd6a None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.186529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff14b-d32b-45ee-a926-9acb754cfd6a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.187209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff14b-d32b-45ee-a926-9acb754cfd6a None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.188380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 272/540] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:02.193769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e57b7-1c8b-449d-9d52-8110676ab7bb None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.194073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e57b7-1c8b-449d-9d52-8110676ab7bb None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.194347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e57b7-1c8b-449d-9d52-8110676ab7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.224718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-a99e57b7-1c8b-449d-9d52-8110676ab7bb None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:02.225944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a99e57b7-1c8b-449d-9d52-8110676ab7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:02.264163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c7e36-7854-4a35-b529-63f0ca00616a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.309578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.310221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.310557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.310835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.311541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:02.311850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.313304 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.333348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 269/541] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:02.340072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 273/542] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:27:02.340221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.475958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.490451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcbf79-df9e-43d7-a3d7-d3eb69a139ff None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.538833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.539449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.539869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.540149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.540886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=9962d812513a428b99ada1f79a5b88d3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:02.541197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.542753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.552747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 270/543] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/role_assignments?user.id=9962d812513a428b99ada1f79a5b88d3&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:02.775644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e57b7-1c8b-449d-9d52-8110676ab7bb None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.904208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e57b7-1c8b-449d-9d52-8110676ab7bb None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.912180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.940414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aca062-074d-43de-883e-ed8bdf8e5daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.941056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aca062-074d-43de-883e-ed8bdf8e5daa None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.941343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aca062-074d-43de-883e-ed8bdf8e5daa None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.941682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aca062-074d-43de-883e-ed8bdf8e5daa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.958486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aca062-074d-43de-883e-ed8bdf8e5daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-85aca062-074d-43de-883e-ed8bdf8e5daa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:02.963331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:02.964302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:02.965109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 274/544] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:02.970814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.111002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcf6c9-ba64-4f15-85b8-922051527247 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.164977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.165587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.165890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.166173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.166931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:03.167425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.168884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.177534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 271/545] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:03.183048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aca062-074d-43de-883e-ed8bdf8e5daa None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.326421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aca062-074d-43de-883e-ed8bdf8e5daa None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.379587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.380153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.380435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.380710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.397619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.399125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:03.418367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:03.420527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:03.422616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:03.422616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:03.422616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:03.422616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 275/546] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:03.425864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.446938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.552249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b3095-4de7-4b25-81a5-5c229998fef0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.593358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be73ab-ea7c-4d49-a9ec-9ef81e9d9c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.594255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be73ab-ea7c-4d49-a9ec-9ef81e9d9c58 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.594681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be73ab-ea7c-4d49-a9ec-9ef81e9d9c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.595097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be73ab-ea7c-4d49-a9ec-9ef81e9d9c58 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.595906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be73ab-ea7c-4d49-a9ec-9ef81e9d9c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:03.596350 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be73ab-ea7c-4d49-a9ec-9ef81e9d9c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.597891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be73ab-ea7c-4d49-a9ec-9ef81e9d9c58 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.615874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 272/547] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:03.621029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.644510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.754039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e97a-c5b4-44be-ae88-a6b1d7f40408 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.790371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.790997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.791277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.791555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.799891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.801374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.805425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438de12-d490-4a8e-bba2-61a711f3333a None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.805960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438de12-d490-4a8e-bba2-61a711f3333a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.806439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438de12-d490-4a8e-bba2-61a711f3333a None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.808255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 273/548] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:03.813751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77584-dbca-4c1c-b136-078c1c6247fc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:03.813899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:03.815569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:03.816977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 276/549] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:03.818164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77584-dbca-4c1c-b136-078c1c6247fc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.818647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77584-dbca-4c1c-b136-078c1c6247fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.820538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.838154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b5f77584-dbca-4c1c-b136-078c1c6247fc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:03.840292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b5f77584-dbca-4c1c-b136-078c1c6247fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:03.917639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.946509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30efdb-034c-4658-8b09-a060831b220d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.990663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.991275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.991561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.991892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.993526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:03.994054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.995826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.015582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 274/551] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:27:04.016091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 277/551] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:04.021067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.062368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f476da-e96d-4793-ac05-a6f577fee903 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.062997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f476da-e96d-4793-ac05-a6f577fee903 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.063516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f476da-e96d-4793-ac05-a6f577fee903 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.066062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 275/552] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:04.069807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77246e1-4bca-46e2-adff-c52371b59449 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.070356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77246e1-4bca-46e2-adff-c52371b59449 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.070734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77246e1-4bca-46e2-adff-c52371b59449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.091898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.117229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a77246e1-4bca-46e2-adff-c52371b59449 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:04.118475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a77246e1-4bca-46e2-adff-c52371b59449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:04.152268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75987aaa-0cda-4206-815e-b47c2839e52b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.199819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60ed8-5e61-46c7-92a5-9652a1bfbd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.200357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60ed8-5e61-46c7-92a5-9652a1bfbd49 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.200633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60ed8-5e61-46c7-92a5-9652a1bfbd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.200902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a60ed8-5e61-46c7-92a5-9652a1bfbd49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.201322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 276/553] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:04.202694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d249d-633c-4a81-9c5b-9bf83b9a36aa None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.202967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d249d-633c-4a81-9c5b-9bf83b9a36aa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.203310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d249d-633c-4a81-9c5b-9bf83b9a36aa None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.204859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 277/554] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:04.214055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.217875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c847628-910a-4dfa-b88f-f6567af44f84 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.218170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c847628-910a-4dfa-b88f-f6567af44f84 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.218443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c847628-910a-4dfa-b88f-f6567af44f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.247868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3c847628-910a-4dfa-b88f-f6567af44f84 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:04.249055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c847628-910a-4dfa-b88f-f6567af44f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:04.335744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60ed8-5e61-46c7-92a5-9652a1bfbd49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.337211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a60ed8-5e61-46c7-92a5-9652a1bfbd49 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.369716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 278/555] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:27:04.371696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c847628-910a-4dfa-b88f-f6567af44f84 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.494579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.528069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 278/556] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:04.528942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60ed8-5e61-46c7-92a5-9652a1bfbd49 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.556198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c847628-910a-4dfa-b88f-f6567af44f84 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.576072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.609399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facef36e-1ce1-4175-985e-c81608e67531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.610378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facef36e-1ce1-4175-985e-c81608e67531 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.610656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facef36e-1ce1-4175-985e-c81608e67531 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.611428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facef36e-1ce1-4175-985e-c81608e67531 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.625185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facef36e-1ce1-4175-985e-c81608e67531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-facef36e-1ce1-4175-985e-c81608e67531 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:04.631009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.631920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:04.633186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:04.637864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 279/557] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.638728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facef36e-1ce1-4175-985e-c81608e67531 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.664675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a60ed8-5e61-46c7-92a5-9652a1bfbd49 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.702533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f0d73-5977-472c-b186-8ff390912962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.703535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0d73-5977-472c-b186-8ff390912962 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.703814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0d73-5977-472c-b186-8ff390912962 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.704130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0d73-5977-472c-b186-8ff390912962 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.715702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f0d73-5977-472c-b186-8ff390912962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-a68f0d73-5977-472c-b186-8ff390912962 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:04.720432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.721338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:04.722222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 279/558] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.724057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f0d73-5977-472c-b186-8ff390912962 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.753648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facef36e-1ce1-4175-985e-c81608e67531 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.778191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.790458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.791085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.791364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.791637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.803386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.804842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:04.820296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.821306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:04.822244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:04.822244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:04.822244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:04.822244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 280/559] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.822244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.831465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.837971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f0d73-5977-472c-b186-8ff390912962 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.874118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.874720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.874996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.875271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.875928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] RBAC: Adding query filter params (name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:04.876230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.877622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.885329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 280/560] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:04.886270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.925968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e5d56-0da1-4f48-9ec5-d6d43d12c12f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.958535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5374e9-c4a8-4466-b7e3-eb48ddfeb6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.959152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5374e9-c4a8-4466-b7e3-eb48ddfeb6ff None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.959430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5374e9-c4a8-4466-b7e3-eb48ddfeb6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.959704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5374e9-c4a8-4466-b7e3-eb48ddfeb6ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.971403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5374e9-c4a8-4466-b7e3-eb48ddfeb6ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-ee5374e9-c4a8-4466-b7e3-eb48ddfeb6ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:04.981722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.982866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:04.983930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 281/561] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.984671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d4d1-80c2-495c-8cf5-352e4b74ad60 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.984671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d4d1-80c2-495c-8cf5-352e4b74ad60 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.984671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d4d1-80c2-495c-8cf5-352e4b74ad60 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.986020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 282/562] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:04.986836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d4d1-80c2-495c-8cf5-352e4b74ad60 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.993246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111c3b2-3b6d-4a50-8c01-f1a6048ae443 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.028963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.029508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.030035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.030035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.030035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.030831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.031429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.032858 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.040956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 281/563] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.041740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.063846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.100416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d4d1-80c2-495c-8cf5-352e4b74ad60 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.134676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.135287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.135614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.135850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.136528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.136804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.138211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.147260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372641f-9542-4ef6-91dd-35081db3c3f0 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.149813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 283/564] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.150636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.183082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a884ff-5e73-4678-a29b-76f4eefcc1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.183700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a884ff-5e73-4678-a29b-76f4eefcc1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.183984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a884ff-5e73-4678-a29b-76f4eefcc1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.184262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a884ff-5e73-4678-a29b-76f4eefcc1f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.194864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a884ff-5e73-4678-a29b-76f4eefcc1f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.196324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a884ff-5e73-4678-a29b-76f4eefcc1f1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-07a884ff-5e73-4678-a29b-76f4eefcc1f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:05.210351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.211470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:05.212530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:05.212530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.212530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:05.212530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 282/565] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.212530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc76c-ac42-4fd4-8cd4-f9702ddebff9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.212839 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc76c-ac42-4fd4-8cd4-f9702ddebff9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.213083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bc76c-ac42-4fd4-8cd4-f9702ddebff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.231467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-d09bc76c-ac42-4fd4-8cd4-f9702ddebff9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:05.232669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d09bc76c-ac42-4fd4-8cd4-f9702ddebff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:05.247129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.253990 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b840c-034e-407b-906a-51e9a4361fda None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.288229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.288755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.289041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.289308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.290006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.290308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.291674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.299478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 284/566] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.312061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 283/567] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:05.312240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.312334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bc76c-ac42-4fd4-8cd4-f9702ddebff9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.312334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.420155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bc76c-ac42-4fd4-8cd4-f9702ddebff9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.421680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75948-8daa-4305-8fb5-00ebe5031c76 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.455679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.455901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.456312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.456522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.456632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.456805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.456901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.457078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.463559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.465722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.471065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.472498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:05.477879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.478775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 284/568] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.479955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:05.491913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.492921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:05.494536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:05.494536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.494536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:05.494536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 285/569] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.498746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.512162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.554283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.600921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cb620-49e1-49c0-8aef-d690da77d582 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.603164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99805c0-61d6-41dd-9a47-6b726343dcc6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.635151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.636298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.636581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.636755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.636996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.637190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.637466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.637645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.637733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.637979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.639379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.649566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.650878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 285/570] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.651032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.652445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:05.667064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.668246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:05.669217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:05.669217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.669217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:05.669217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 286/571] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.669217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.733769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.757206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537efed-9968-4610-bd0b-16d1896df77a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.775361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd32c1-efed-438e-8f96-b15e861d093d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.780667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.792278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.792891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.793175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.793447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.794180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.794493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.795927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.808457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 286/572] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.808930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.810378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.810988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.811352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.811541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.812740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.812740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.813857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.826227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 287/573] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.827029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.910377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34501b15-8a6a-40ce-a466-a2db30ddbf3b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.925272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2630-ffc4-4470-b13d-0befaa2a4bf0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.944166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a33c0-4852-43f5-89d8-6e9e9bcd093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.944791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a33c0-4852-43f5-89d8-6e9e9bcd093c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.945079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a33c0-4852-43f5-89d8-6e9e9bcd093c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.945353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a33c0-4852-43f5-89d8-6e9e9bcd093c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.948944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.955903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a33c0-4852-43f5-89d8-6e9e9bcd093c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:05.960959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-5f7a33c0-4852-43f5-89d8-6e9e9bcd093c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:05.961108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.962161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:05.963004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:05.963660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.963660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.963830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 287/574] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.963900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.964023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a33c0-4852-43f5-89d8-6e9e9bcd093c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.973359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.975224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:05.986870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.988018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 288/575] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.988961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.011574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.073998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a33c0-4852-43f5-89d8-6e9e9bcd093c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.089555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fce28-8feb-44a5-b73e-3633d01e5613 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.107010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.107612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.107895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.108169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.108809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.109109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.110525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.122965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 288/576] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.123775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.124013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.124871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.125357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.125767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.126810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=36a184d53f1e4ebaaf55beee0f889bd8) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.127589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.128546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.134244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 289/577] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/role_assignments?user.id=36a184d53f1e4ebaaf55beee0f889bd8&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.135041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.199365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.253293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa37d40-9b39-4f17-bc6d-3a406816797a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.255823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.259837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067093-b864-4bae-b808-b1c40790736e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.297745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.298470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.298750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.299027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.302038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.302640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.302918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.303186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.303838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.304139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.305525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.306468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.308480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.317889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 290/578] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.317889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:06.323400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:06.324573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 289/579] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:06.325559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.426351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80d44-4a43-4d22-a92a-2cb5d793881f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.434351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88007db-a65f-4559-abe4-e1c720eecc6d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.437193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.465414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.466063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.466433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.466605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.467546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.467838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.469421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.475918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.476771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.477364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.477809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.488312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.488924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 291/580] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.489757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.490504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:06.505876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:06.507110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 290/581] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:06.508127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.536527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.602717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a0f06-bbf5-48a0-bf20-91436cf4d35d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.619261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79187b5c-53e9-41cb-a3ee-8be6eef51cd4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.640162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.640890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.641175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.641460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.652618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.654119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.658557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.659164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.659445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.659716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.660443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.660747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.662205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:06.670203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:06.671203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:06.672106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:06.672106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:06.672106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:06.674327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 292/582] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:06.674820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.682797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 291/583] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.683731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.698997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.772306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.786827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9f53-ca21-44b2-ab14-5eeeb5d6c836 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.795481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99926c6e-ac3d-45f5-b2b4-1b7a4aa135ed None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.822389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a787406-8043-4d55-869e-271917536e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.824109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a787406-8043-4d55-869e-271917536e45 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.824403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a787406-8043-4d55-869e-271917536e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.824675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a787406-8043-4d55-869e-271917536e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.835498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a787406-8043-4d55-869e-271917536e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.836953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a787406-8043-4d55-869e-271917536e45 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.838293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.839654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.840109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.840218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.840903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.841204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.842648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-9a787406-8043-4d55-869e-271917536e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:06.851850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:06.852850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:06.853775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:06.853775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:06.853775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:06.853775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 293/584] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:06.853775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a787406-8043-4d55-869e-271917536e45 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.863929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 292/585] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.864994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.931973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.967204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a787406-8043-4d55-869e-271917536e45 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.972445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f14e6e-f991-43c5-9a22-7d65d620099e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.003399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.004134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.004582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.004938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.005614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.006044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.007487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.007796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.008428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.008712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.008988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.016845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.020976 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.022880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.028161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 294/586] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.028161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:07.044545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.045732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:07.046902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:07.046902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:07.046902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:07.052621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 293/587] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.052621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.145075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01d8e-0bf1-4822-a851-93e65254a34a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.173472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259808d-c40e-4615-9f2c-7b92bbc012a9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.177333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.183964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.184620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.185084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.185509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.186270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.186765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.188227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.200393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 295/588] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.201556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.221290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.222275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.222708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.223131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.235427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.237355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:07.252295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.253392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:07.254556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:07.254556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:07.254556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:07.255943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 294/589] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.256861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.304307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.315422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686886ff-aa91-4424-91d7-703329ee7c8a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.350577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.351305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.351650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.351993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.360760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.362674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.365672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ca268-9213-43e9-a9b4-6777bb69fe5d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:07.374448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.375555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:07.376686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:07.378196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 296/590] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.379685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.408020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.408625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.408924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.409177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.409823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.410156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.411554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.423712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 295/591] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.424356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.445426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.508070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77bcf8-8798-414f-aa3d-f84d4a280070 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.540785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb24e0-bd7e-4941-b9e4-b33a3c3b43db None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.543465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.546758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.547396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.547679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.547956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.554967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.556426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:07.568517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.569427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 297/592] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.570370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.587527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.588375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.588833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.589275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.590254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.590722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.592235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.604097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 296/593] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.605973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.694121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dcb92-b639-462e-a9a3-9fc2fd3c8593 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.705304 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.715662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb79ce2-14f3-4703-bd1d-cd39bf6adff2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.732876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.733491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.733789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.734087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.734808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.735110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.736790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.752551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.753192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.753502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.753751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.760033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 298/594] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.761153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.761668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.762644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:07.773884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.774938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 297/595] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.775826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.809542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.883704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc2ebb-5389-4e36-aa7c-e0779353828a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.894214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed0d24-0ac4-4055-bd37-63d9b216c8b3 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.922345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.923194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.923640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.923918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.924616 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.924924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.926381 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.933936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.934619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.934907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.935274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.943498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 299/596] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.943498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.945275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.946775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:07.958524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.959603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:07.960791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 298/597] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.965475 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.974788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.055831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd9165-36bf-47e1-8961-865fd1f14c47 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.070792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.090092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819010d7-a28f-456a-8d8c-ce2e9b00e9af None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.093614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.094272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.094557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.094832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.106152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.107597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:08.121587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:08.127544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:08.129215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:08.129215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:08.129215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:08.129215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 300/598] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:08.129215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.129574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.129574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.129574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.129574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.129930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:08.129930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.130079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.142412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 299/599] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:08.143231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.211424 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.232325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1c4eb-62f5-4b53-94db-c6783c1f69bb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.247050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b9d17-3925-460d-8555-a2dcfa7b16f8 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.265488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b272-7f9e-410f-8727-d15099cec125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.266167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b272-7f9e-410f-8727-d15099cec125 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.266447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b272-7f9e-410f-8727-d15099cec125 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.266718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b272-7f9e-410f-8727-d15099cec125 None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/38af4d5f21ae43b699d7890ce9534d29/roles/ea03b7919cca4616936c45ad11b68389` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.281128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.281324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b272-7f9e-410f-8727-d15099cec125 None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=38af4d5f21ae43b699d7890ce9534d29, role_id=ea03b7919cca4616936c45ad11b68389)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.281734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.282041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.282319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.282735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b272-7f9e-410f-8727-d15099cec125 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.282999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:08.283304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.284723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.295068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 301/600] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:08 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/38af4d5f21ae43b699d7890ce9534d29/roles/ea03b7919cca4616936c45ad11b68389 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:08.296039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bbe91-45a3-4019-81e2-e9afdaf276f0 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.296319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bbe91-45a3-4019-81e2-e9afdaf276f0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.296591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bbe91-45a3-4019-81e2-e9afdaf276f0 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.301876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 300/601] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:08.301876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.302127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 302/602] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:08.302127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bbe91-45a3-4019-81e2-e9afdaf276f0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.308935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.427501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4009226-e910-4c06-bd17-2af70f886749 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.435386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bbe91-45a3-4019-81e2-e9afdaf276f0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.468702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.469355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.469509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.469652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.469936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.470577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:08.470877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.472257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.475816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c89e-6f57-42e9-b34a-493aff54b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.476723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c89e-6f57-42e9-b34a-493aff54b052 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.477191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c89e-6f57-42e9-b34a-493aff54b052 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.477667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c89e-6f57-42e9-b34a-493aff54b052 None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/3adaa1462c8a4acdab7e631a795cd40f/roles/ea03b7919cca4616936c45ad11b68389` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.488270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 301/603] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:08.489375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.498968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c89e-6f57-42e9-b34a-493aff54b052 None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=3adaa1462c8a4acdab7e631a795cd40f, role_id=ea03b7919cca4616936c45ad11b68389)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.500942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c89e-6f57-42e9-b34a-493aff54b052 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.515752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 303/604] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:08 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/3adaa1462c8a4acdab7e631a795cd40f/roles/ea03b7919cca4616936c45ad11b68389 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:08.517483 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343d8a-d77f-44a3-aea2-92d8b35a3ad9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.518084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343d8a-d77f-44a3-aea2-92d8b35a3ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.518895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343d8a-d77f-44a3-aea2-92d8b35a3ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.544930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-54343d8a-d77f-44a3-aea2-92d8b35a3ad9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:08.547405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54343d8a-d77f-44a3-aea2-92d8b35a3ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:08.563516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.624803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5937b34-58b8-4ecf-b28b-5623590c6b9f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.639533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 304/605] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:08.640691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54343d8a-d77f-44a3-aea2-92d8b35a3ad9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.692551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3bd30-ba68-47c9-88bd-ca472b460c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.693425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3bd30-ba68-47c9-88bd-ca472b460c12 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.693805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3bd30-ba68-47c9-88bd-ca472b460c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.694202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3bd30-ba68-47c9-88bd-ca472b460c12 None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/a0c16885de9e4e82bcbede361e548ec9/roles/ea03b7919cca4616936c45ad11b68389` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.712105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3bd30-ba68-47c9-88bd-ca472b460c12 None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=a0c16885de9e4e82bcbede361e548ec9, role_id=ea03b7919cca4616936c45ad11b68389)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.714376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3bd30-ba68-47c9-88bd-ca472b460c12 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.731121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 302/606] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:08 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/a0c16885de9e4e82bcbede361e548ec9/roles/ea03b7919cca4616936c45ad11b68389 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:08.802309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54343d8a-d77f-44a3-aea2-92d8b35a3ad9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.824168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.862603 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.863346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.863626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.863897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.873054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.874586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:08.888584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:08.889722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:08.890851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 305/607] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:08.898055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3bd30-ba68-47c9-88bd-ca472b460c12 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.975395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.017990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3bd30-ba68-47c9-88bd-ca472b460c12 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.049347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.095406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.096786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.097236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.097651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.098525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:09.098970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.100557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.118165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 303/608] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:09.120717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.129795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69e4ab-a929-406a-94d4-281c1d3ccce6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.197006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd111464-4846-4ee6-b438-fb99d7bd169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.197646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd111464-4846-4ee6-b438-fb99d7bd169e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.197963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd111464-4846-4ee6-b438-fb99d7bd169e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.198290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd111464-4846-4ee6-b438-fb99d7bd169e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.216922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd111464-4846-4ee6-b438-fb99d7bd169e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-bd111464-4846-4ee6-b438-fb99d7bd169e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:09.221651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:09.222897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:09.223943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:09.224730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 306/609] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:09.234662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd111464-4846-4ee6-b438-fb99d7bd169e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.278314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.353798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2201de-a27c-4ea5-aa74-ab687bd0aa6a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.357981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd111464-4846-4ee6-b438-fb99d7bd169e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.398125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.398736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.399017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.399290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.399952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:09.400256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.402507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.410792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 307/610] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:09.416305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.474581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b83d6b-fb38-493e-b83c-d6c0995202da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.475269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b83d6b-fb38-493e-b83c-d6c0995202da None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.475554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b83d6b-fb38-493e-b83c-d6c0995202da None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.475829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b83d6b-fb38-493e-b83c-d6c0995202da None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/9962d812513a428b99ada1f79a5b88d3/roles/ea03b7919cca4616936c45ad11b68389` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.518266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.525395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d1bc-bac1-44f9-b503-c2f86bed182a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.543382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b83d6b-fb38-493e-b83c-d6c0995202da None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=9962d812513a428b99ada1f79a5b88d3, role_id=ea03b7919cca4616936c45ad11b68389)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.544803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b83d6b-fb38-493e-b83c-d6c0995202da None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.565591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.566337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.566678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.566960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.582220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.584241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.592284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 304/611] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:09 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/9962d812513a428b99ada1f79a5b88d3/roles/ea03b7919cca4616936c45ad11b68389 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:09.600898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:09.602149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:09.603248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:09.603248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:09.603248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:09.606130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 308/612] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:09.608731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b83d6b-fb38-493e-b83c-d6c0995202da None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.639840 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.725081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b83d6b-fb38-493e-b83c-d6c0995202da None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.764767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.765393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.765678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.765984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.766632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:09.766937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.768335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.785379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 305/613] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:09.787354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.906261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b8f5-b3b3-4b0c-880d-ab0d470f9548 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.949615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.950283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.950565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.950915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.959161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.960621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:09.972250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:09.973226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:09.974209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:09.977971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 309/614] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:09.980044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.068280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.087269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463b6cb-7e5f-48bc-a02f-8060e36c6f6c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.123939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.124566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.124814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.125085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.125813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:10.126143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.127847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.151859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 306/615] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:10.153351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.171206 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.300576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b24f56-8982-4278-9385-b9bc819a74ce None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.348481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f573-1bc1-4b3c-b156-dc12a9005f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.349117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f573-1bc1-4b3c-b156-dc12a9005f88 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.349398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f573-1bc1-4b3c-b156-dc12a9005f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.349672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f573-1bc1-4b3c-b156-dc12a9005f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.366364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f573-1bc1-4b3c-b156-dc12a9005f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.367812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f573-1bc1-4b3c-b156-dc12a9005f88 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5032f573-1bc1-4b3c-b156-dc12a9005f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:10.385484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:10.386791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:10.387683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:10.387683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:10.387683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:10.387683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 310/616] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:10.394949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.507600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce814f-cde2-4a3e-b31f-b171ac83803c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.507891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce814f-cde2-4a3e-b31f-b171ac83803c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.508074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce814f-cde2-4a3e-b31f-b171ac83803c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.509658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 311/617] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:10.516836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a1e2-8aba-43be-8d80-6c83490fad04 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.517124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a1e2-8aba-43be-8d80-6c83490fad04 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.517401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520a1e2-8aba-43be-8d80-6c83490fad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.525472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924e58-29c8-4b8c-b30a-d2dfba7388e6 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.561047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.561666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.562005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.562254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.562902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:10.563210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.564705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.565664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b520a1e2-8aba-43be-8d80-6c83490fad04 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:10.566905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b520a1e2-8aba-43be-8d80-6c83490fad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:10.574257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.581927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 307/618] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:10.583136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.688914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.692377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa6af-4a15-4a2f-8428-655d5f0c6b03 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.707075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 312/619] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:10.753607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22f96d-7c21-470e-a633-fbef5c81cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.754271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f96d-7c21-470e-a633-fbef5c81cbfe None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.754552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f96d-7c21-470e-a633-fbef5c81cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.754825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f96d-7c21-470e-a633-fbef5c81cbfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.770926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22f96d-7c21-470e-a633-fbef5c81cbfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.772326 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22f96d-7c21-470e-a633-fbef5c81cbfe None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-0d22f96d-7c21-470e-a633-fbef5c81cbfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:10.787037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:10.788168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:10.789080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 308/620] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:10.794262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520a1e2-8aba-43be-8d80-6c83490fad04 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.950332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753681a2-4a3d-4d50-a521-39d44c0a46c8 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.950748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753681a2-4a3d-4d50-a521-39d44c0a46c8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.950852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753681a2-4a3d-4d50-a521-39d44c0a46c8 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.951178 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520a1e2-8aba-43be-8d80-6c83490fad04 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.952212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 309/621] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:10.959429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e38c66-f6b1-4313-a2aa-87692d0ff8b6 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.959711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e38c66-f6b1-4313-a2aa-87692d0ff8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.959987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e38c66-f6b1-4313-a2aa-87692d0ff8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.000297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b9e38c66-f6b1-4313-a2aa-87692d0ff8b6 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:11.003004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b9e38c66-f6b1-4313-a2aa-87692d0ff8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:11.021622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.022664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.023141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.023605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.024747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.026587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.028223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.045976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 313/622] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:11.047102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.080584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.092716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 310/623] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:11.093625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e38c66-f6b1-4313-a2aa-87692d0ff8b6 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.109413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.192243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852b7fc-d811-4698-bd75-b6b6ed33b3de None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.230469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881ae5-0c17-417f-9700-7221d2754c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.231107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881ae5-0c17-417f-9700-7221d2754c51 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.231391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881ae5-0c17-417f-9700-7221d2754c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.231664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b881ae5-0c17-417f-9700-7221d2754c51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.236789 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e38c66-f6b1-4313-a2aa-87692d0ff8b6 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.242611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b881ae5-0c17-417f-9700-7221d2754c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4b881ae5-0c17-417f-9700-7221d2754c51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:11.248542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:11.249466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:11.250364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 314/624] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:11.258621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881ae5-0c17-417f-9700-7221d2754c51 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.285190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236d2a6-4a89-446b-af1b-1887c972bca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.285826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d2a6-4a89-446b-af1b-1887c972bca6 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.286144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d2a6-4a89-446b-af1b-1887c972bca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.286425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d2a6-4a89-446b-af1b-1887c972bca6 None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/36a184d53f1e4ebaaf55beee0f889bd8/roles/ea03b7919cca4616936c45ad11b68389` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.312512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d2a6-4a89-446b-af1b-1887c972bca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=36a184d53f1e4ebaaf55beee0f889bd8, role_id=ea03b7919cca4616936c45ad11b68389)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.314129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d2a6-4a89-446b-af1b-1887c972bca6 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.327815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 311/625] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:11 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/36a184d53f1e4ebaaf55beee0f889bd8/roles/ea03b7919cca4616936c45ad11b68389 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:11.329223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb626-29fd-4438-959c-503371604bc4 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.329508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb626-29fd-4438-959c-503371604bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.329781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb626-29fd-4438-959c-503371604bc4 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.335466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 312/626] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:11.337245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e449e-2da5-43c0-bcf9-8a5643335e20 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.337604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e449e-2da5-43c0-bcf9-8a5643335e20 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.337988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e449e-2da5-43c0-bcf9-8a5643335e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.358959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-bc1e449e-2da5-43c0-bcf9-8a5643335e20 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:11.360374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bc1e449e-2da5-43c0-bcf9-8a5643335e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:11.402309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.446126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 313/627] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:11.449521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b881ae5-0c17-417f-9700-7221d2754c51 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.460791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.504861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.505465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.505742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.506041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.506704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.507002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.508370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.521297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 315/628] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:11.527907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e449e-2da5-43c0-bcf9-8a5643335e20 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.539689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.649447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f48a-1fc8-4de5-bdd7-d4c0860048e2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.654129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e449e-2da5-43c0-bcf9-8a5643335e20 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.687081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2f31e-a2d3-4d0a-94cc-09a6e7a5f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.687709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2f31e-a2d3-4d0a-94cc-09a6e7a5f94b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.687983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2f31e-a2d3-4d0a-94cc-09a6e7a5f94b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.688256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2f31e-a2d3-4d0a-94cc-09a6e7a5f94b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.695889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.696773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.697060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.697487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.701252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2f31e-a2d3-4d0a-94cc-09a6e7a5f94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f9b2f31e-a2d3-4d0a-94cc-09a6e7a5f94b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:11.706580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:11.708736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:11.710808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 316/629] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:11.711817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.711817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.719082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2f31e-a2d3-4d0a-94cc-09a6e7a5f94b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:11.728655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:11.731042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:11.732934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:11.732934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:11.732934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:11.737982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 314/630] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:11.743070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.751577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.776012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.839474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2f31e-a2d3-4d0a-94cc-09a6e7a5f94b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.882710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe3bbd-147d-4687-8db3-0e35751364f2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.883286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.883953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.884231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.884499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.885207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.885824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.888216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.901965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 317/631] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:11.903166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.925704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.926700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.927199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.927689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.928546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.929059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.930695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.949191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 315/632] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:11.950486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.020403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.039049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ace1d-b17e-4d97-b434-d725692828c9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.067862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.082245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a697844-c8cf-4253-9557-18ddae2ce7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.082873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a697844-c8cf-4253-9557-18ddae2ce7ee None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.083153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a697844-c8cf-4253-9557-18ddae2ce7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.083437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a697844-c8cf-4253-9557-18ddae2ce7ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.090195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de65b7-0f95-4e22-bffb-1043c497b91c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.099925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a697844-c8cf-4253-9557-18ddae2ce7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8a697844-c8cf-4253-9557-18ddae2ce7ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:12.107101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:12.108065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 318/633] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:12.109515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a697844-c8cf-4253-9557-18ddae2ce7ee None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.136470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.139759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.140419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.140912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.153496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.155307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:12.173101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:12.174095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:12.174997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:12.174997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:12.174997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:12.177245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 316/634] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:12.178344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.234668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a697844-c8cf-4253-9557-18ddae2ce7ee None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.272328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.272953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.273231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.273499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.281733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.283390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.286802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8707bd-4182-40ca-8c2d-b3c57d4b2d98 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:12.295026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:12.296020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 319/635] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:12.297010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.310026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.328260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106511a-fb09-4f24-b8af-ccfaa1b1211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.328865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106511a-fb09-4f24-b8af-ccfaa1b1211d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.329148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106511a-fb09-4f24-b8af-ccfaa1b1211d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.329419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106511a-fb09-4f24-b8af-ccfaa1b1211d None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.330112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106511a-fb09-4f24-b8af-ccfaa1b1211d None admin] RBAC: Adding query filter params (name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.330415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106511a-fb09-4f24-b8af-ccfaa1b1211d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.331775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106511a-fb09-4f24-b8af-ccfaa1b1211d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.333229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.341785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 317/636] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.343019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1349b0-dda2-434b-8de2-7e5d454f3259 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.343305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1349b0-dda2-434b-8de2-7e5d454f3259 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.343579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1349b0-dda2-434b-8de2-7e5d454f3259 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.348759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 318/637] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:12.348759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1349b0-dda2-434b-8de2-7e5d454f3259 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.419980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7675f1-2583-428d-bc0b-6a2ce6b4efb8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.453229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1349b0-dda2-434b-8de2-7e5d454f3259 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.457268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.458455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.458933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.459385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.460205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.460716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.462118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.479334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 320/638] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.479334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.491463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6511-e0c5-4d77-bf71-8d3d65d108b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.492373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6511-e0c5-4d77-bf71-8d3d65d108b7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.492657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6511-e0c5-4d77-bf71-8d3d65d108b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.493079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6511-e0c5-4d77-bf71-8d3d65d108b7 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.493794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6511-e0c5-4d77-bf71-8d3d65d108b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.494140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6511-e0c5-4d77-bf71-8d3d65d108b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.496085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6511-e0c5-4d77-bf71-8d3d65d108b7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.514891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 319/639] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.516071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a06d59-f133-4a0f-97da-6d5185e3867c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.516350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a06d59-f133-4a0f-97da-6d5185e3867c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.516618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a06d59-f133-4a0f-97da-6d5185e3867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.534104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-49a06d59-f133-4a0f-97da-6d5185e3867c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:12.535280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-49a06d59-f133-4a0f-97da-6d5185e3867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:12.556881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.589212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.593388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190147e-1627-498e-b7ea-4871b07f8889 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.613308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 320/640] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:12.613308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a06d59-f133-4a0f-97da-6d5185e3867c None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.636372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.637226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.637688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.638122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.649680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.651569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:12.667644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:12.668638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:12.669518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:12.669518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:12.669518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:12.676589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 321/641] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:12.677886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.742833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a06d59-f133-4a0f-97da-6d5185e3867c None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.781408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.782411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.782987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.783446 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.786510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee27551-bb86-4b35-966f-6cc6e593ffc7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.791310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.793397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:12.806323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:12.807377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:12.808501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:12.809813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.816237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 321/642] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:12.817345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.821296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0349f4-7da6-40da-a202-75b868b304d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.822408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0349f4-7da6-40da-a202-75b868b304d6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.823485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0349f4-7da6-40da-a202-75b868b304d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.824154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0349f4-7da6-40da-a202-75b868b304d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.877214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.898442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0349f4-7da6-40da-a202-75b868b304d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.900012 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0349f4-7da6-40da-a202-75b868b304d6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.935808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024f6b-a6dc-4f11-be1b-e17427538836 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.977550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.978427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.978885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.979951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.980742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.981191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.983543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.996804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 322/643] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.997803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.012161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 322/644] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:13.013186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0349f4-7da6-40da-a202-75b868b304d6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.038808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.116917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c849b5-afb5-4e6c-9c74-aaf6966ac864 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.121024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.138353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0349f4-7da6-40da-a202-75b868b304d6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.163068 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.164018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.164362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.164643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.165377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:13.165686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.167341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.175510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa699c-73db-40ac-85b2-28b17ae20a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.176456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa699c-73db-40ac-85b2-28b17ae20a7d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.176734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa699c-73db-40ac-85b2-28b17ae20a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.177004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa699c-73db-40ac-85b2-28b17ae20a7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.189643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 323/645] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:13.189643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.193416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa699c-73db-40ac-85b2-28b17ae20a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-bcaa699c-73db-40ac-85b2-28b17ae20a7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:13.199296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:13.200243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:13.201815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 323/646] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:13.206096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa699c-73db-40ac-85b2-28b17ae20a7d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.294753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.296237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb13ca8-b808-4050-86cf-17759708eae2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.315008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa699c-73db-40ac-85b2-28b17ae20a7d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.333625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.334287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.334569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.334843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.342361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.343799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.350456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.351068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.351343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.351611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:13.355346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:13.356275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 324/647] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:13.362875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.366579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.368061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:13.383378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:13.384371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:13.385281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:13.385281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:13.385281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:13.385281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 324/648] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:13.388316 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.475347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3678d-9243-47d5-ad1d-f7733f620144 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.492648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1c9a1-2189-4a45-aaba-d536f05376b2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.515654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1534ace-6bfa-4a95-8b67-bdeb18b6ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.516607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1534ace-6bfa-4a95-8b67-bdeb18b6ca30 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.517109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1534ace-6bfa-4a95-8b67-bdeb18b6ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.517456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1534ace-6bfa-4a95-8b67-bdeb18b6ca30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.529513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.530399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.530678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.530948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.531609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:13.531908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.533260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.534699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.543131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 325/649] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:13.544167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.587983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1534ace-6bfa-4a95-8b67-bdeb18b6ca30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.589582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1534ace-6bfa-4a95-8b67-bdeb18b6ca30 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.613799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.647422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5f86a-0030-4a1b-a18d-36ced8e22f54 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.681132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c1698-0374-4654-bc4b-ad21247a801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.681735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1698-0374-4654-bc4b-ad21247a801a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.682048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1698-0374-4654-bc4b-ad21247a801a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.682580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c1698-0374-4654-bc4b-ad21247a801a None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.683201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c1698-0374-4654-bc4b-ad21247a801a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:13.683512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c1698-0374-4654-bc4b-ad21247a801a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.684941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c1698-0374-4654-bc4b-ad21247a801a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.689628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 325/650] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:13.690499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1534ace-6bfa-4a95-8b67-bdeb18b6ca30 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.702868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 326/651] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:13.704095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb84e4-5180-4aac-8b63-0bb9e3f32f7e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.704373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb84e4-5180-4aac-8b63-0bb9e3f32f7e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.704648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb84e4-5180-4aac-8b63-0bb9e3f32f7e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.705862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 327/652] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:13.706558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb84e4-5180-4aac-8b63-0bb9e3f32f7e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.763968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.797649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1534ace-6bfa-4a95-8b67-bdeb18b6ca30 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.810635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb84e4-5180-4aac-8b63-0bb9e3f32f7e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.821253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.833447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.834072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.834342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.834615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.835242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:13.835540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.836904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.845432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.846090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.846372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.846672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.848879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 326/653] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:13.849571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.861523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.862999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:13.878048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:13.879229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:13.880217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:13.880217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:13.880217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:13.880217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 328/654] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:13.880458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.956342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c53355-f6f5-4165-86b3-0b29ad708895 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.982510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410e30b-2cb4-4150-9744-3d48888b1ec8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.989481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.990314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa88b7c-5a2f-4569-a48b-d67644dfa4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.990945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa88b7c-5a2f-4569-a48b-d67644dfa4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.991260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa88b7c-5a2f-4569-a48b-d67644dfa4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.991497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa88b7c-5a2f-4569-a48b-d67644dfa4c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.002714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa88b7c-5a2f-4569-a48b-d67644dfa4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.004191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa88b7c-5a2f-4569-a48b-d67644dfa4c0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-1fa88b7c-5a2f-4569-a48b-d67644dfa4c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:14.018740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.019846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:14.025496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:14.025496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:14.025496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:14.025719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be578f80-1f0e-48db-9a63-f654a2e0b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.025832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 327/655] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.025943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578f80-1f0e-48db-9a63-f654a2e0b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.025943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578f80-1f0e-48db-9a63-f654a2e0b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.025943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578f80-1f0e-48db-9a63-f654a2e0b2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.026264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be2d2-e0e2-4cd1-aec2-09d8545de41d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.026264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be2d2-e0e2-4cd1-aec2-09d8545de41d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.026264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be2d2-e0e2-4cd1-aec2-09d8545de41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.039550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ec9be2d2-e0e2-4cd1-aec2-09d8545de41d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:14.040863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ec9be2d2-e0e2-4cd1-aec2-09d8545de41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:14.067361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.089653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be578f80-1f0e-48db-9a63-f654a2e0b2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.091173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be578f80-1f0e-48db-9a63-f654a2e0b2e4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.107766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 328/656] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:14.108595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be2d2-e0e2-4cd1-aec2-09d8545de41d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.196625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 329/657] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:14.197282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be578f80-1f0e-48db-9a63-f654a2e0b2e4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.206990 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.234148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be2d2-e0e2-4cd1-aec2-09d8545de41d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.272168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.273001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.273352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.273698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.280768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.282333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:14.294793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.295894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 329/658] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.297266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.309075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be578f80-1f0e-48db-9a63-f654a2e0b2e4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.324770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.356215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.357251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.357596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.358238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.359338 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.359716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.361153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.379844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 330/659] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.380685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.425345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b591ad6-16a3-42e1-8136-3be5d34916d9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.460585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.470183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.470798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.471080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.471355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.472411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.472739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.474210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.488641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 330/660] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.489642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.500033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e1d28-cae0-493b-8955-d4dc41949d77 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.536126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.536854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.537222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.537567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.548196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.549726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:14.565979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.567030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:14.572688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:14.572688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:14.572688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:14.572688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 331/661] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.572688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.583572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.605220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e8cf6-c1af-4091-9815-a6b57bdec000 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.647422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.648036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.648332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.648594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.649287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.649592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.651623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.665431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 331/662] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.666296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.678301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15854b7b-45a0-4364-9ab9-1a8974868551 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.696057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.713656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46cb9-0b32-4e73-8de5-6ffe38bc528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.714243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46cb9-0b32-4e73-8de5-6ffe38bc528f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.714531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46cb9-0b32-4e73-8de5-6ffe38bc528f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.714807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46cb9-0b32-4e73-8de5-6ffe38bc528f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.725601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46cb9-0b32-4e73-8de5-6ffe38bc528f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d9e46cb9-0b32-4e73-8de5-6ffe38bc528f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:14.730946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.732048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:14.732984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 332/663] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.733693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46cb9-0b32-4e73-8de5-6ffe38bc528f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.769514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa7706-eb83-43ed-a574-815ba41faf59 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.810787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.811413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.811690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.811960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.819010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.820450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:14.832574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.833695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:14.834867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:14.835544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46cb9-0b32-4e73-8de5-6ffe38bc528f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.835641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 332/664] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.835641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.838384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.873095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.873728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.874044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.874323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.881173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.882660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:14.894591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.895673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:14.896599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 333/665] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.897092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.937597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.939888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c58dc-404b-4850-b1b7-ef5baf5a1a30 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.974067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.974694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.974970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.975240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.975878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.976174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.977533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.989610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 333/666] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.990632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.997900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184da73-3a65-470c-93c9-ae09cb3cb4e5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.030857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.031452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.031733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.032006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.032722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=38af4d5f21ae43b699d7890ce9534d29) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.033026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.034491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.040036 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 334/667] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/role_assignments?user.id=38af4d5f21ae43b699d7890ce9534d29&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.040804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.055697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.099026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6e91-05b3-4a49-9a97-b63a4759caf8 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.141955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.142678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.143032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.143376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.144131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] RBAC: Adding query filter params (name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.144509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.146016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.155538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 334/668] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.161124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.179122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0e40-72da-4b7e-8388-4036ee470373 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.180708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.220842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.221592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.222028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.223086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.223086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.223505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.225066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.244637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 335/669] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.247665 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.288406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03081b9-f707-4e47-a761-b4c6eec77c7f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.314615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.325337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.325983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.326269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.327152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.327267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.327524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.329019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.343421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 335/670] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.344077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.363074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1295c-3ba8-4215-91eb-7239166cb562 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.397365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.398029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.398312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.398585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.405990 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.407441 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:15.418877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:15.420199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 336/671] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:15.422134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.444649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.465424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e57e-9e9a-46fb-b989-ad2622f33f89 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.503782 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.504334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.504615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.504888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.516633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.518432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.526356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd2046-0899-4690-914a-8179eaba7cd0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:15.533889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:15.535046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:15.536099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:15.536099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:15.536099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:15.536099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 336/672] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:15.539191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.576759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad932f-5deb-4736-aaeb-e90e70ca2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.577380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad932f-5deb-4736-aaeb-e90e70ca2697 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.577663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad932f-5deb-4736-aaeb-e90e70ca2697 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.577986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad932f-5deb-4736-aaeb-e90e70ca2697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.581368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.644366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464ee9c-c1d6-4025-b8a2-5e3cde917f7e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.655755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad932f-5deb-4736-aaeb-e90e70ca2697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.657206 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad932f-5deb-4736-aaeb-e90e70ca2697 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.678379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.678994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.679129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.679286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.679537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.680257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=3adaa1462c8a4acdab7e631a795cd40f) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.680565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.682788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.688810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 337/673] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/role_assignments?user.id=3adaa1462c8a4acdab7e631a795cd40f&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.689598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.814274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 337/674] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:15.815334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad932f-5deb-4736-aaeb-e90e70ca2697 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.865947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65544014-0b71-44c3-88dd-26ca24258784 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.869623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.921378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.922067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.922356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.922627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.923331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.923635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.925518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.940489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 338/675] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.941408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.957506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad932f-5deb-4736-aaeb-e90e70ca2697 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.982955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.001901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.002513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.002797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.003480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.004141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.004447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.006143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.022426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 338/676] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:16.028018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.075458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6397-f728-4413-aaeb-703ee262f7ed None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.117968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.118870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.119151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.119423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.135277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.138046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:16.164459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:16.165508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:16.166458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:16.166458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:16.166458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:16.169979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 339/677] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:16.171047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.173150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aab53-8639-4e53-865d-a780e6c16ad3 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.196201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.222467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.223098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.223389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.223666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.224424 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=a0c16885de9e4e82bcbede361e548ec9) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.224734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.226622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.237976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 339/678] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/role_assignments?user.id=a0c16885de9e4e82bcbede361e548ec9&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:16.239156 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.335490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.359698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80871a-61cc-4512-a56d-2fbedead66b2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.399804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.400953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.401472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.401979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.410765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.412505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:16.424893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:16.425905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:16.426881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:16.429797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 340/679] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:16.435121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.463115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb84c70-6043-4f4c-a799-d52f6915d88b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.515122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.516780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.517398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.518006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.519105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.520011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.522281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.538797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.540500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 340/680] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:16.546673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.570853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8d77-1c2e-46ab-a725-37417798f46f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.616627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.617157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.617438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.617712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.618473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.618780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.620280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.639363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 341/681] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:16.645798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.673897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816242b4-102f-419c-a707-37c5b4ecfef8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.676599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.715049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.716095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.716595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.717067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.724588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.726404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:16.739759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:16.740712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:16.741634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:16.741634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:16.741634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:16.741634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:16.741634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:16.741634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:16.741634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:16.741634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:16.744111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 341/682] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:16.750377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.756287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea993fa-0f39-4148-849f-b40c41f47dd0 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.789823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.796716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cb9d9-b717-4f0b-a082-38a3b498f1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.797344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cb9d9-b717-4f0b-a082-38a3b498f1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.797626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cb9d9-b717-4f0b-a082-38a3b498f1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.797996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cb9d9-b717-4f0b-a082-38a3b498f1c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.874510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bb6c6-e519-41eb-ba3a-a3488cda5446 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.900196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cb9d9-b717-4f0b-a082-38a3b498f1c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.903378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cb9d9-b717-4f0b-a082-38a3b498f1c5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.915468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.916084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.916365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.916669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.917370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.917673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.919144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.936071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 342/683] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:16.943496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.019211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.041184 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 342/684] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:27:17.048014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cb9d9-b717-4f0b-a082-38a3b498f1c5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.100833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.170161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820dee0-ac09-465e-8b3c-da0ee4d93a41 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.206339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03f936-67af-4e62-8505-74ff1969371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.206948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03f936-67af-4e62-8505-74ff1969371d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.207230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03f936-67af-4e62-8505-74ff1969371d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.207502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03f936-67af-4e62-8505-74ff1969371d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.208232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03f936-67af-4e62-8505-74ff1969371d None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=9962d812513a428b99ada1f79a5b88d3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:17.208539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03f936-67af-4e62-8505-74ff1969371d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.209600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cb9d9-b717-4f0b-a082-38a3b498f1c5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.209998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03f936-67af-4e62-8505-74ff1969371d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.216230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 343/685] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/role_assignments?user.id=9962d812513a428b99ada1f79a5b88d3&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:17.217507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362d45-4803-4f38-9a41-f7642586a2fe None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.217795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362d45-4803-4f38-9a41-f7642586a2fe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.218094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362d45-4803-4f38-9a41-f7642586a2fe None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.219499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 344/686] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:17.226032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d788a-b541-4fef-9bc7-44e21926b0be None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.226326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d788a-b541-4fef-9bc7-44e21926b0be None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.226594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d788a-b541-4fef-9bc7-44e21926b0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.259665 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-113d788a-b541-4fef-9bc7-44e21926b0be None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:17.261594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-113d788a-b541-4fef-9bc7-44e21926b0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:17.277818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.278593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.278868 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.279135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.298531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.300192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:17.330204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:17.331465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:17.333508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:17.333508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:17.333508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:17.333508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 343/687] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:17.339789 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.341386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 345/688] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:27:17.442342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.468841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f610ed-4825-424d-8fa4-5c653075e64a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.520372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.520980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.521258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.521526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.522194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:17.522493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.523866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.537900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 344/689] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:17.545178 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d788a-b541-4fef-9bc7-44e21926b0be None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.568380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.656643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d788a-b541-4fef-9bc7-44e21926b0be None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.692747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.693357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.693674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.693946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.701700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.703243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:17.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:17.717495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:17.719651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 346/690] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:17.722912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.726505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.814464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.837748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e77dd-4fa5-457e-a544-f43a1f925892 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.847620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b03f2a-fb42-4800-8732-1ced91820eef None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.881684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad2eac-2f85-4fd1-8106-97dc3a8df41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.882355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2eac-2f85-4fd1-8106-97dc3a8df41d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.882637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2eac-2f85-4fd1-8106-97dc3a8df41d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.882914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad2eac-2f85-4fd1-8106-97dc3a8df41d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.902753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad2eac-2f85-4fd1-8106-97dc3a8df41d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b8ad2eac-2f85-4fd1-8106-97dc3a8df41d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:17.908617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:17.909580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:17.910547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:17.911226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 347/691] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:17.919725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad2eac-2f85-4fd1-8106-97dc3a8df41d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.927537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.928371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.928815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.929256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.930146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:17.930620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.932347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.961261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 345/692] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:17.975778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.002219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.034651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad2eac-2f85-4fd1-8106-97dc3a8df41d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.073467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54001af-ca4c-4499-9a93-69acca22c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.074132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54001af-ca4c-4499-9a93-69acca22c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.075267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54001af-ca4c-4499-9a93-69acca22c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.075544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54001af-ca4c-4499-9a93-69acca22c3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.076217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54001af-ca4c-4499-9a93-69acca22c3e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:18.076525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54001af-ca4c-4499-9a93-69acca22c3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.077928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54001af-ca4c-4499-9a93-69acca22c3e5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.098099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.099416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 348/693] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:18.101051 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6b26-542a-41a7-bebf-54d0b46b1b5e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.103105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6b26-542a-41a7-bebf-54d0b46b1b5e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.103385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6b26-542a-41a7-bebf-54d0b46b1b5e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.106476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 349/694] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:18.106476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f6b26-542a-41a7-bebf-54d0b46b1b5e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.168214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc65ad-1df8-4b99-b045-799eb65d03c9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.207436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62754486-a4b2-43e6-98c3-cfca17734ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.208418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62754486-a4b2-43e6-98c3-cfca17734ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.208902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62754486-a4b2-43e6-98c3-cfca17734ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.209397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62754486-a4b2-43e6-98c3-cfca17734ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.210370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62754486-a4b2-43e6-98c3-cfca17734ae7 None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=36a184d53f1e4ebaaf55beee0f889bd8) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:18.210879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62754486-a4b2-43e6-98c3-cfca17734ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.212676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62754486-a4b2-43e6-98c3-cfca17734ae7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.220493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 346/695] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/role_assignments?user.id=36a184d53f1e4ebaaf55beee0f889bd8&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:18.222347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e7aec-302a-4059-aa94-b84675ab84f1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.222853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e7aec-302a-4059-aa94-b84675ab84f1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.223350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e7aec-302a-4059-aa94-b84675ab84f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.226636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f6b26-542a-41a7-bebf-54d0b46b1b5e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.264222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-424e7aec-302a-4059-aa94-b84675ab84f1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:18.266094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-424e7aec-302a-4059-aa94-b84675ab84f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:18.307173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.309091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.310974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.311501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.332540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.334427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:18.353122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:18.354267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:18.355171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:18.355171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:18.355171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:18.358962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 350/696] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:18.365996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.404393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.413413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 347/697] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:18.450332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.500199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391a73a-3305-455f-bb2a-de77b7f51277 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.535404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.536007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.536288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.536558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.537183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:18.537480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.538909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.551794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 351/698] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:18.556941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e7aec-302a-4059-aa94-b84675ab84f1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.681191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e7aec-302a-4059-aa94-b84675ab84f1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.706982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.726395 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.727044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.727331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.727784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.740559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.742154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:18.758231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:18.759202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:18.760137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 348/699] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:18.765309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.848533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e580-ce23-4105-bb44-0d1a68066b0e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.863657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.865829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.895787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926401e-b834-4a7e-a78c-8f826b2c2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.896588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926401e-b834-4a7e-a78c-8f826b2c2d22 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.896871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926401e-b834-4a7e-a78c-8f826b2c2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.897284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926401e-b834-4a7e-a78c-8f826b2c2d22 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.898037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926401e-b834-4a7e-a78c-8f826b2c2d22 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.899908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926401e-b834-4a7e-a78c-8f826b2c2d22 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.906543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12f514-1b08-489a-a074-c6e3e2144c89 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8926401e-b834-4a7e-a78c-8f826b2c2d22 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:18.914247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:18.915315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:18.916153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 352/700] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:18.917155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aa489-8f9e-4413-86a9-253d1812ab5f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.917976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aa489-8f9e-4413-86a9-253d1812ab5f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.917976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aa489-8f9e-4413-86a9-253d1812ab5f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.923014 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 353/701] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:18.923014 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aa489-8f9e-4413-86a9-253d1812ab5f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.960649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a6910-da99-4767-9f65-752daf3d6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.960649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6910-da99-4767-9f65-752daf3d6547 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.960649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6910-da99-4767-9f65-752daf3d6547 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.963098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6910-da99-4767-9f65-752daf3d6547 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.963098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a6910-da99-4767-9f65-752daf3d6547 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:18.963098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a6910-da99-4767-9f65-752daf3d6547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.964171 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a6910-da99-4767-9f65-752daf3d6547 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.990339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 349/702] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:18.991569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559191-4dbd-453a-be8d-51f5d74ac0dc None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.991755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559191-4dbd-453a-be8d-51f5d74ac0dc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.992030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559191-4dbd-453a-be8d-51f5d74ac0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.009862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-58559191-4dbd-453a-be8d-51f5d74ac0dc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:19.011976 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-58559191-4dbd-453a-be8d-51f5d74ac0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:19.062651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aa489-8f9e-4413-86a9-253d1812ab5f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.090200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 350/703] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:19.091138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58559191-4dbd-453a-be8d-51f5d74ac0dc None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.100564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.101443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.101959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.102435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.103317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:19.103860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.106296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.112193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 354/704] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:19.120423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.184044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.233398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.294435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58559191-4dbd-453a-be8d-51f5d74ac0dc None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.300992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e6e45-4b41-4691-a094-f88c6814f814 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.334617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea6e7f-87e6-45da-b9d4-7a7fe79f3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.335793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea6e7f-87e6-45da-b9d4-7a7fe79f3d73 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.336277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea6e7f-87e6-45da-b9d4-7a7fe79f3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.336908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea6e7f-87e6-45da-b9d4-7a7fe79f3d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.372919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.373932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.374429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.375146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.375988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:19.376490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.378263 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.394245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 355/705] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:19.395364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.508666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2c5bf-9de7-4f3e-9dc4-090c0ef8bab3 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.518255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.526741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea6e7f-87e6-45da-b9d4-7a7fe79f3d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.528618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea6e7f-87e6-45da-b9d4-7a7fe79f3d73 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.549639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.550681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.551159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.551629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.563830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.566056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:19.581509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:19.582559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:19.583544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:19.583544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:19.583544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:19.585582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 356/706] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:19.592312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.622254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.673357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 351/707] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:19.678734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea6e7f-87e6-45da-b9d4-7a7fe79f3d73 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.733508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b7450-33db-4be1-8f08-652f5cbc909b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.784410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea6e7f-87e6-45da-b9d4-7a7fe79f3d73 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.798614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.799332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.799618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.800056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.800655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:19.800961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.802473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.820921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.821554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.821827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.822128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.830691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 357/708] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:19.835540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.838410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.840619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.848032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:19.857719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:19.858716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:19.859610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:19.859610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:19.859610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:19.859610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 352/709] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:19.865345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.890733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.980199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65e5b6-98a3-4b3d-9e7b-65d871c368ed None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.999002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e886394-83bb-4e1e-88e9-880faa50de03 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.017454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b823b-7743-469b-ba7f-9d9c307924a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.018417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b823b-7743-469b-ba7f-9d9c307924a7 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.018924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b823b-7743-469b-ba7f-9d9c307924a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.019396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b823b-7743-469b-ba7f-9d9c307924a7 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.020332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b823b-7743-469b-ba7f-9d9c307924a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.022009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b823b-7743-469b-ba7f-9d9c307924a7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.043566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.046479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 358/710] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:27:19 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:20.048062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca352ca-25ab-4357-8726-9f2492356848 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.048612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca352ca-25ab-4357-8726-9f2492356848 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.049090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca352ca-25ab-4357-8726-9f2492356848 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.050807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 359/711] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:20.054382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.055016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.055539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.056647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:20.057831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.060751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb17e-d042-4dd1-993d-570aef51c146 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.061038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb17e-d042-4dd1-993d-570aef51c146 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.061362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb17e-d042-4dd1-993d-570aef51c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.063583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.083922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aadfb17e-d042-4dd1-993d-570aef51c146 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:20.086430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aadfb17e-d042-4dd1-993d-570aef51c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:20.094491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 353/712] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:20.099503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.238241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:20.239570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 360/713] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:20.283469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e378f-e552-4f89-babc-ec397a7d3ed3 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.321166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.321724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.322036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.322313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.329343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.330826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:20.342229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:20.343215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:20.344113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 354/714] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:20.349305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb17e-d042-4dd1-993d-570aef51c146 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.351882 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:20.462818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb17e-d042-4dd1-993d-570aef51c146 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.501494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.502188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.502463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.502730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.503426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:20.503727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.505145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.518267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 361/715] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:20.524190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.582276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.655356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:20.658564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5938e6-c82f-4134-ac52-b4cbadfe172e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.677933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:20.697328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.698597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.699056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.699335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.700183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=38af4d5f21ae43b699d7890ce9534d29) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:20.700500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.702086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.703606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70f5c5-1854-4d00-ac1c-52f14ec7ab2c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.708472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 355/716] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/role_assignments?user.id=38af4d5f21ae43b699d7890ce9534d29&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=cac8d7ae8325488684667d62304b0860 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:20.743885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1294046-c5f8-4843-8345-5ecd0cb00ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.744533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1294046-c5f8-4843-8345-5ecd0cb00ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.745491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1294046-c5f8-4843-8345-5ecd0cb00ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.746337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1294046-c5f8-4843-8345-5ecd0cb00ef3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.746970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1294046-c5f8-4843-8345-5ecd0cb00ef3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.748493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1294046-c5f8-4843-8345-5ecd0cb00ef3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e1294046-c5f8-4843-8345-5ecd0cb00ef3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:20.758246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:20.760698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:20.763268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:20.765885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 362/717] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:20.767157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.927549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0a7d5-cde8-484f-bb5f-a622cd1e8330 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.934290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16257eb8-467d-4acb-9ec5-f41b265da265 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.934572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16257eb8-467d-4acb-9ec5-f41b265da265 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.934848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16257eb8-467d-4acb-9ec5-f41b265da265 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.939919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 363/718] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:20.941372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e6163-d68c-4d68-931c-39b063c1e58a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.941661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e6163-d68c-4d68-931c-39b063c1e58a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.941966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e6163-d68c-4d68-931c-39b063c1e58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.967315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.968173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.968607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.969063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.969563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b85e6163-d68c-4d68-931c-39b063c1e58a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:20.973888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b85e6163-d68c-4d68-931c-39b063c1e58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:20.977867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] RBAC: Adding query filter params (name=network) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:20.977867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.977867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.988365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 356/719] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:20.993135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.092095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 364/720] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:21.112678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:21.160927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79e096-a660-4a8c-ae50-8cf7edda294c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:21.199049 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:21.199577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.199853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.200120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.200747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] RBAC: Adding query filter params (type=network) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:21.201045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:21.202452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:21.214860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 357/721] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:21.434949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e6163-d68c-4d68-931c-39b063c1e58a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.494222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:21.549131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e6163-d68c-4d68-931c-39b063c1e58a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:21.583494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2616106-0cde-4b75-86f0-463888a83391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:21.584119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2616106-0cde-4b75-86f0-463888a83391 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.584383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2616106-0cde-4b75-86f0-463888a83391 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.584656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2616106-0cde-4b75-86f0-463888a83391 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.595781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2616106-0cde-4b75-86f0-463888a83391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b2616106-0cde-4b75-86f0-463888a83391 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:21.600853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:21.601820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:21.602744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 365/722] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:21.608341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.772096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c1ae-a0ff-40fd-8b73-a40adffd641f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:21.791345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:21.816842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064f7f-e53c-4b89-8a3b-988a8b23cdbd None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.817148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064f7f-e53c-4b89-8a3b-988a8b23cdbd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.817557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca064f7f-e53c-4b89-8a3b-988a8b23cdbd None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.820626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 366/723] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:21.826477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d254aa-f844-4770-8448-69649a62fe34 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.826764 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:21.826888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d254aa-f844-4770-8448-69649a62fe34 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.827160 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d254aa-f844-4770-8448-69649a62fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.827877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.828350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.828822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.829680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:21.830196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:21.831757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:21.846510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-64d254aa-f844-4770-8448-69649a62fe34 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:21.847777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-64d254aa-f844-4770-8448-69649a62fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:21.849903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 358/724] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:21.855518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.933987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 367/725] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:21.991038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a400c69-3b54-4515-bb6b-d003135f075c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.034551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.035109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.035392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.035667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.050044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.051592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:22.066432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:22.067431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:22.068350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:22.068350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:22.068350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:22.068350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 359/726] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:22.076448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d254aa-f844-4770-8448-69649a62fe34 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.174007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.247067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d254aa-f844-4770-8448-69649a62fe34 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.292689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.293221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.293871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.293871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.294550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:22.294871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.294983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.296813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.312782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 368/727] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:22.326148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.356564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.455910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc6f6f-3633-4d21-93e7-b691f72d7c6f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.470238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.524291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f95aa7-b71d-4fb6-b1a1-1d0dce2ca731 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.531032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.532003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.532426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.533048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.551480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.555128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:22.577143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:22.578372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:22.580126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:22.587779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 369/728] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:22.598466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.650631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef42c-1ce6-40a9-9984-6e840d47b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.651558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef42c-1ce6-40a9-9984-6e840d47b312 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.651985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef42c-1ce6-40a9-9984-6e840d47b312 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.652445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef42c-1ce6-40a9-9984-6e840d47b312 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.653546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef42c-1ce6-40a9-9984-6e840d47b312 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.655950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef42c-1ce6-40a9-9984-6e840d47b312 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.700613 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 360/729] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:22 2022] POST /identity/v3/services => generated 251 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:22.724303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b66bdc-1bd6-4314-b362-b85032f28161 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.797578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6fa91-dbd6-40cf-9194-2023999b5eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.798234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6fa91-dbd6-40cf-9194-2023999b5eed None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.798515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6fa91-dbd6-40cf-9194-2023999b5eed None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.798786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6fa91-dbd6-40cf-9194-2023999b5eed None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.799523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6fa91-dbd6-40cf-9194-2023999b5eed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:22.799823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6fa91-dbd6-40cf-9194-2023999b5eed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.801814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6fa91-dbd6-40cf-9194-2023999b5eed None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.827158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 370/730] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:22.833187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef42c-1ce6-40a9-9984-6e840d47b312 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.991343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.015579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef42c-1ce6-40a9-9984-6e840d47b312 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.060834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef73e12-7d01-45b4-9f45-2d72c85a0599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.061813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73e12-7d01-45b4-9f45-2d72c85a0599 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.062262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73e12-7d01-45b4-9f45-2d72c85a0599 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.062436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef73e12-7d01-45b4-9f45-2d72c85a0599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.085620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f470ad-4f46-47d0-a470-9b9bd0f68c8c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.086066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f470ad-4f46-47d0-a470-9b9bd0f68c8c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.086244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f470ad-4f46-47d0-a470-9b9bd0f68c8c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.087854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 371/731] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:23.098319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486fb0-d188-4dad-86b8-e9a2e7fb9ee7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.098595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486fb0-d188-4dad-86b8-e9a2e7fb9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.098870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14486fb0-d188-4dad-86b8-e9a2e7fb9ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.124564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14486fb0-d188-4dad-86b8-e9a2e7fb9ee7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:23.126639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14486fb0-d188-4dad-86b8-e9a2e7fb9ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:23.154035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.169896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef73e12-7d01-45b4-9f45-2d72c85a0599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.171391 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef73e12-7d01-45b4-9f45-2d72c85a0599 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.242743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 372/732] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:23.275840 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.294926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 361/733] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:23.303197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14486fb0-d188-4dad-86b8-e9a2e7fb9ee7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.375744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910bb28-4af8-4949-93d8-cbe0d12ee44c None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.376192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910bb28-4af8-4949-93d8-cbe0d12ee44c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.376585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910bb28-4af8-4949-93d8-cbe0d12ee44c None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.378253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 362/734] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:23.383454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428490b0-8469-4336-92d7-3d19a49cfa04 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.383845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428490b0-8469-4336-92d7-3d19a49cfa04 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.384225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428490b0-8469-4336-92d7-3d19a49cfa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.418722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14486fb0-d188-4dad-86b8-e9a2e7fb9ee7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.419999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-428490b0-8469-4336-92d7-3d19a49cfa04 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:23.421320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-428490b0-8469-4336-92d7-3d19a49cfa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:23.457167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.458167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.458716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.459188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.470722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.472534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:23.489696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:23.490794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:23.491688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:23.491688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:23.491688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:23.494436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 373/735] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:23.506873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.513550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.543485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 363/736] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:27:23.584129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428490b0-8469-4336-92d7-3d19a49cfa04 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.686670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3118d-5787-4531-907a-2a649851dd1d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.725017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a85efc-ed1e-42ac-b0bd-6512a83d8b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.726046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a85efc-ed1e-42ac-b0bd-6512a83d8b76 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.726532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a85efc-ed1e-42ac-b0bd-6512a83d8b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.727164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a85efc-ed1e-42ac-b0bd-6512a83d8b76 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.728147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a85efc-ed1e-42ac-b0bd-6512a83d8b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:23.728651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a85efc-ed1e-42ac-b0bd-6512a83d8b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.731143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a85efc-ed1e-42ac-b0bd-6512a83d8b76 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.737632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428490b0-8469-4336-92d7-3d19a49cfa04 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.745637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 374/737] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:23.747445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813bf3-6245-470f-a550-5170a8cdc571 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.747933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813bf3-6245-470f-a550-5170a8cdc571 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.748407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813bf3-6245-470f-a550-5170a8cdc571 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.750520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 375/738] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:23.751425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813bf3-6245-470f-a550-5170a8cdc571 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.754304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.778631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0a04a-472c-45fb-9f6e-e8d59baf8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.779694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a04a-472c-45fb-9f6e-e8d59baf8454 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.780073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a04a-472c-45fb-9f6e-e8d59baf8454 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.780445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a04a-472c-45fb-9f6e-e8d59baf8454 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.793697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0a04a-472c-45fb-9f6e-e8d59baf8454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-95b0a04a-472c-45fb-9f6e-e8d59baf8454 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:23.798665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:23.799745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:23.800608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:23.803222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 364/739] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:23.804619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab62a-7fe5-4554-bac6-9b1081a2a552 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.805067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab62a-7fe5-4554-bac6-9b1081a2a552 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.805522 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab62a-7fe5-4554-bac6-9b1081a2a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.824987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-bd2ab62a-7fe5-4554-bac6-9b1081a2a552 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:23.826482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bd2ab62a-7fe5-4554-bac6-9b1081a2a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:23.829482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.871283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813bf3-6245-470f-a550-5170a8cdc571 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.905917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 365/740] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:23.907416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab62a-7fe5-4554-bac6-9b1081a2a552 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.917398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.918427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.918891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.919846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.929476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.932506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:23.948676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:23.949656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:23.950587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:23.950587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:23.950587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:23.950587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:23.950587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:23.950587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:23.950587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:23.950587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:23.951023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 376/741] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:23.952078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.024353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab62a-7fe5-4554-bac6-9b1081a2a552 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.028069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.072298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.073706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.074537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.075034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.076543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] RBAC: Adding query filter params (name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.077343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.078965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.079150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f040db-0274-41e5-aaf7-3f2ce0b9d761 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.091579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 366/742] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.092983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.112945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.129752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30dde-cf81-4ad8-9189-895fa159512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.131528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30dde-cf81-4ad8-9189-895fa159512e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.132090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30dde-cf81-4ad8-9189-895fa159512e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.132490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e30dde-cf81-4ad8-9189-895fa159512e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.145677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e30dde-cf81-4ad8-9189-895fa159512e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-76e30dde-cf81-4ad8-9189-895fa159512e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:24.152909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:24.153915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:24.154778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:24.158186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 377/743] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:24.159183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30dde-cf81-4ad8-9189-895fa159512e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.219212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461365e-e902-4626-9791-d927d10f9546 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.255556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.256158 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.256438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.256707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.257387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.257695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.259215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.276216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 367/744] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.277425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.286559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e30dde-cf81-4ad8-9189-895fa159512e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.307689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.324440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.324771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.325052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.325324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.336353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.338636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:24.355228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:24.356357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:24.357302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:24.357302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:24.357302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:24.357302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 378/745] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:24.357302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.391444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.399990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd665b7-7137-430d-994e-24ed9bf1e824 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.436373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.436982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.437266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.437543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.438266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.438574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.439987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.448752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 368/746] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.449399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.468539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08eec4c-b7e3-4f1a-822e-8cade6e029cb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.504464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece765de-724d-4b04-b82a-5a0fd12e6418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.505021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece765de-724d-4b04-b82a-5a0fd12e6418 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.505614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece765de-724d-4b04-b82a-5a0fd12e6418 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.505916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece765de-724d-4b04-b82a-5a0fd12e6418 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.506829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece765de-724d-4b04-b82a-5a0fd12e6418 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.508358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece765de-724d-4b04-b82a-5a0fd12e6418 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.525204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 379/747] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:24 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:24.526750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece765de-724d-4b04-b82a-5a0fd12e6418 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.575589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f32f-0b33-4f73-a8d3-767e4489d6a4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.590355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.624762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.625805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.626489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.626965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.628007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=36a184d53f1e4ebaaf55beee0f889bd8) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.628542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.630255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.640200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 369/748] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/role_assignments?user.id=36a184d53f1e4ebaaf55beee0f889bd8&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=cac8d7ae8325488684667d62304b0860 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.641547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.682395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.693477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece765de-724d-4b04-b82a-5a0fd12e6418 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.737426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218885b-6731-408d-9236-20921ba04792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.738711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218885b-6731-408d-9236-20921ba04792 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.739233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218885b-6731-408d-9236-20921ba04792 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.740000 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218885b-6731-408d-9236-20921ba04792 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.741918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218885b-6731-408d-9236-20921ba04792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.742469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218885b-6731-408d-9236-20921ba04792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.744185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218885b-6731-408d-9236-20921ba04792 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.762870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 380/749] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.768261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218885b-6731-408d-9236-20921ba04792 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.781945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36674d8-b76f-4200-92f3-cce2860024dc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.821157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.822285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.823370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.823871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.836085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.837922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.847828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:24.856072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:24.857036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:24.857950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:24.857950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:24.857950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:24.857950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 370/750] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:24.867003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.910998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218885b-6731-408d-9236-20921ba04792 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.955946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.956496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.956779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.957053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.973629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.975935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:25.004220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:25.005235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:25.006229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 381/751] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:25.013038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.043516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.050030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477636e1-21a7-4e09-8d72-65c8f7bcc31b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.090509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.091521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.091948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.092428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.093450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:25.094330 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.096014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.111055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 371/752] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:25.120286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.223234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.232484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb36482-e973-4542-b383-6affacf71a36 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.270799 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d6238-4d5f-4fa2-8c81-aca1d7907f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.271325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6238-4d5f-4fa2-8c81-aca1d7907f1b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.271606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6238-4d5f-4fa2-8c81-aca1d7907f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.271888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d6238-4d5f-4fa2-8c81-aca1d7907f1b None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.273163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d6238-4d5f-4fa2-8c81-aca1d7907f1b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:25.273815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d6238-4d5f-4fa2-8c81-aca1d7907f1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.278412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d6238-4d5f-4fa2-8c81-aca1d7907f1b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.286542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7257-881b-4055-b306-f2f21a2919ff None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.306251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 382/753] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:25.307689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7dc61-2f8c-4814-9792-c52fc8206b5d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.307973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7dc61-2f8c-4814-9792-c52fc8206b5d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.308244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7dc61-2f8c-4814-9792-c52fc8206b5d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.310300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 383/754] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:25.319174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d31d9-4482-4b50-ad1a-440e1cace5fe None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.319367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d31d9-4482-4b50-ad1a-440e1cace5fe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.319636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d31d9-4482-4b50-ad1a-440e1cace5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.327981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.328831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.329287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.329706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.337540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.338106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-831d31d9-4482-4b50-ad1a-440e1cace5fe None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:25.339981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.340459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-831d31d9-4482-4b50-ad1a-440e1cace5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:25.352198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:25.353346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:25.354939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:25.357504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 372/755] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:25.358572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.425986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 384/756] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:25.425986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d31d9-4482-4b50-ad1a-440e1cace5fe None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.434198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.506209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7780cc-0cb3-40c3-92c4-a91295cb8e9e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.544060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.568742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1a2b-9dd4-4f7a-bf6c-470ec0b9389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.569350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1a2b-9dd4-4f7a-bf6c-470ec0b9389b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.569627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1a2b-9dd4-4f7a-bf6c-470ec0b9389b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.569921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1a2b-9dd4-4f7a-bf6c-470ec0b9389b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.595994 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d31d9-4482-4b50-ad1a-440e1cace5fe None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.664290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.664896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.665173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.665446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.666195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:25.666596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.668349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca1a2b-9dd4-4f7a-bf6c-470ec0b9389b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.669796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca1a2b-9dd4-4f7a-bf6c-470ec0b9389b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.671976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.699302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 385/757] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:25.703374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.799136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.816459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 373/758] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:25.822267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1a2b-9dd4-4f7a-bf6c-470ec0b9389b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.847108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.852646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6bbfb-0b51-485e-8ab3-ca8a6b505159 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.903109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.903757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.904040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.904319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.918087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.919559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:25.940355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:25.941341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:25.942289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:25.942289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:25.942289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:25.943735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1a2b-9dd4-4f7a-bf6c-470ec0b9389b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.945910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 386/759] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:25.948385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.984576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.985709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.986550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.987075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.987894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.989754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:26.004759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:26.005826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:26.006701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:26.014913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 374/760] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:26.016228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.082213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7f389-c7d1-429a-aec0-9a0ae034fed9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.098995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.118150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.133930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.133930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.133930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.135760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.147192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95d359-6255-4a7b-b50f-514a91850e8e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.148901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.150948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:26.165284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:26.166540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:26.167727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:26.167727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:26.167727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:26.173761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 387/761] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:26.174499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.191913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.193112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.193574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.194296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.195092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.195686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.197554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.215464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 375/762] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.216512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.309891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be0c5-dff0-4bd4-950d-53afa0e18f19 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.340187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365959b-ebcf-4bf3-acf4-0ce0fd271807 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.353329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.354792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.355256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.355722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.356636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.357218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.358809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.369071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 388/763] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.370879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.379975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.380733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.381402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.381516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.382253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.382679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.384251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.402370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.402560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 376/764] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.404228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.408971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.483877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe654d-8097-45dd-8e45-a4cf13659e05 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.519392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d339212-edc4-46ac-96ed-5e071dc20147 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.523229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.524107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.524591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.525083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.532957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.534915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:26.547632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:26.548545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:26.549467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:26.549467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:26.549467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:26.549467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:26.549467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:26.549467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:26.549467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:26.549467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:26.551958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 389/765] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:26.552964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.562188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.562806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.563142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.563427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.564248 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.564478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.565902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.576760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 377/766] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.576760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.646459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.660646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.674808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496eeb6-5b36-4b17-bf49-e03333d15653 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.687245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e1bd5-59b5-4795-8e35-40d353d69567 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.712428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f69a5-43a3-4380-88e8-9d3881cdee58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.714563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f69a5-43a3-4380-88e8-9d3881cdee58 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.715056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f69a5-43a3-4380-88e8-9d3881cdee58 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.715592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f69a5-43a3-4380-88e8-9d3881cdee58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.723539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f69a5-43a3-4380-88e8-9d3881cdee58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.725361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.725621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f69a5-43a3-4380-88e8-9d3881cdee58 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.726008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.726296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.726607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.727477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.727793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.729791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-ec4f69a5-43a3-4380-88e8-9d3881cdee58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:26.739887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:26.740856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:26.741795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:26.741795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:26.741795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:26.741795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:26.741795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:26.741795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:26.741795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:26.741795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:26.743020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 378/767] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.743863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.745140 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 390/768] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:26.746710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda341b-95a2-45ef-914c-62084eff1e9f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.747248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda341b-95a2-45ef-914c-62084eff1e9f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.747722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda341b-95a2-45ef-914c-62084eff1e9f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.749472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 391/769] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:26.750573 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda341b-95a2-45ef-914c-62084eff1e9f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.858070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda341b-95a2-45ef-914c-62084eff1e9f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.858804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a2ee-82bf-4716-9cd2-28e558d08d45 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.885977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.892004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2eae9-936e-42ab-aa84-1e4daa91ce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.892658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2eae9-936e-42ab-aa84-1e4daa91ce84 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.892946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2eae9-936e-42ab-aa84-1e4daa91ce84 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.893219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2eae9-936e-42ab-aa84-1e4daa91ce84 None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/38af4d5f21ae43b699d7890ce9534d29/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.894120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.894723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.895005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.895138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2eae9-936e-42ab-aa84-1e4daa91ce84 None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=38af4d5f21ae43b699d7890ce9534d29, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.895276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.895971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] RBAC: Adding query filter params (interface=public, service_id=71320ba521274139a805fc09b1084486, region_id=RegionOne) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.896277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.896614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2eae9-936e-42ab-aa84-1e4daa91ce84 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.897625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.905990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 379/770] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/endpoints?service_id=71320ba521274139a805fc09b1084486&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.906789 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.912647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 392/771] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:26 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/38af4d5f21ae43b699d7890ce9534d29/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:26.913989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d0161-6597-425a-852f-d56b1808df8c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.914299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d0161-6597-425a-852f-d56b1808df8c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.914571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d0161-6597-425a-852f-d56b1808df8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.934280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b15d0161-6597-425a-852f-d56b1808df8c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:26.935505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b15d0161-6597-425a-852f-d56b1808df8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:26.937819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.015553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 393/772] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:27.017021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb0b1-ae29-4235-ab54-5aba963f0b2d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.017307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb0b1-ae29-4235-ab54-5aba963f0b2d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.017578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfb0b1-ae29-4235-ab54-5aba963f0b2d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.022007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 394/773] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:27.022007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfb0b1-ae29-4235-ab54-5aba963f0b2d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.040050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bf228-1e38-4f06-bc1e-6efca7ec188a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.086279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfc49a-a917-4686-8970-b6dd633ed495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.087037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc49a-a917-4686-8970-b6dd633ed495 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.087382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc49a-a917-4686-8970-b6dd633ed495 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.087733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc49a-a917-4686-8970-b6dd633ed495 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.089604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfc49a-a917-4686-8970-b6dd633ed495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:27.089957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfc49a-a917-4686-8970-b6dd633ed495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.091455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfc49a-a917-4686-8970-b6dd633ed495 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.105127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 380/774] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:27.106618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b98ae0-8454-4cee-903a-daa781066357 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.106919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b98ae0-8454-4cee-903a-daa781066357 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.107182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b98ae0-8454-4cee-903a-daa781066357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.129957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-91b98ae0-8454-4cee-903a-daa781066357 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:27.131261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-91b98ae0-8454-4cee-903a-daa781066357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:27.161636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfb0b1-ae29-4235-ab54-5aba963f0b2d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.196894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.209595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1974-31fb-4176-9fc1-3a155e91a13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.210971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1974-31fb-4176-9fc1-3a155e91a13c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.211569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1974-31fb-4176-9fc1-3a155e91a13c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.212023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1974-31fb-4176-9fc1-3a155e91a13c None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.213061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed1974-31fb-4176-9fc1-3a155e91a13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.215524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed1974-31fb-4176-9fc1-3a155e91a13c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.222208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 395/775] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:27.223172 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 381/776] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:27.223505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1974-31fb-4176-9fc1-3a155e91a13c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.230257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.353891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b98ae0-8454-4cee-903a-daa781066357 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.365667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1974-31fb-4176-9fc1-3a155e91a13c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.434851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.435474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.435757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.436025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.436816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=4be8758e659641e6bf49f7cc60b5e2d9) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:27.437130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.438736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.461234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 396/777] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/role_assignments?user.id=4be8758e659641e6bf49f7cc60b5e2d9&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:27.507994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b98ae0-8454-4cee-903a-daa781066357 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.519071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.550711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.551584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.551966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.552344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] PATH_INFO: `/v3/services/network` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.553045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.554652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:27.566770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:27.568054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:27.569090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:27.575811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 382/778] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:27.577614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.609961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.635357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.661647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b6adb-2425-414e-9f24-5ca4a645b30b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.701832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b115b7-e734-4864-808b-87cfc0d279da None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.704961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49580f51-42bc-4e12-928b-db357bd82fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.705569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49580f51-42bc-4e12-928b-db357bd82fbb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.705864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49580f51-42bc-4e12-928b-db357bd82fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.706153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49580f51-42bc-4e12-928b-db357bd82fbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.720450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49580f51-42bc-4e12-928b-db357bd82fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-49580f51-42bc-4e12-928b-db357bd82fbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:27.726557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:27.727504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:27.728392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 397/779] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:27.734759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49580f51-42bc-4e12-928b-db357bd82fbb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.749737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.750749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.751339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.751886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.752759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:27.753284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.755097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.761266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 383/780] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:27.766854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.886543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3e0cc-0c7b-4ba0-ac2a-7c81436e20a1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.899696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.929720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.930402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.930663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.930940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.931584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:27.932467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.934354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.940689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 384/781] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:27.946165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.981234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49580f51-42bc-4e12-928b-db357bd82fbb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.038571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.063201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.063786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.064066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.064338 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.065010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:28.065315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.066711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.086297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 398/782] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:28.091052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.229013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16526cb5-9cd0-49a7-988d-36ccea12e152 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.237204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e5355-13f4-46ba-b5c0-a503682de8b3 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.274457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.275299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.275756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.276203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.277065 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] RBAC: Adding query filter params (interface=public, service_id=cf445f1a283a4007ae166bcb7ddfda79, region_id=RegionOne) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:28.277531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.279076 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.284894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 385/783] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/endpoints?service_id=cf445f1a283a4007ae166bcb7ddfda79&interface=public®ion_id=RegionOne => generated 194 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:28.293048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.311398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.312172 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.312554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.312928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.329778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.332208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:28.356317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:28.357524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:28.358655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:28.358655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:28.358655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:28.361513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 399/784] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:28.366797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.384309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.434065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.501797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f5bca-e677-4ebb-b700-85712ea92bd1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.540344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd49f-5082-4fc1-83b4-6dee47c12192 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.558095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162d2f-cf90-4580-b953-59ec88bde688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.558887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162d2f-cf90-4580-b953-59ec88bde688 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.559325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162d2f-cf90-4580-b953-59ec88bde688 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.559697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162d2f-cf90-4580-b953-59ec88bde688 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.565860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85162d2f-cf90-4580-b953-59ec88bde688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.565860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85162d2f-cf90-4580-b953-59ec88bde688 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.567677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 386/785] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/services => generated 772 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:28.625253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.626181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.626611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.627067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.627890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:28.628344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.633993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.654222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 400/786] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:28.660054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162d2f-cf90-4580-b953-59ec88bde688 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.803945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162d2f-cf90-4580-b953-59ec88bde688 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.805683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.847512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.848388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.848846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.849266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.857694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.859444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:28.871688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:28.872885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:28.874063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:28.876166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 387/787] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:28.881495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.014960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.024617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bc21d-7e17-4e71-8767-de91c50bf365 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.069555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be792-a70e-4664-81ab-8348bdf958da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.070109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be792-a70e-4664-81ab-8348bdf958da None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.070391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be792-a70e-4664-81ab-8348bdf958da None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.070662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be792-a70e-4664-81ab-8348bdf958da None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.071394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18be792-a70e-4664-81ab-8348bdf958da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:29.071696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18be792-a70e-4664-81ab-8348bdf958da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.073168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18be792-a70e-4664-81ab-8348bdf958da None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.095936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 401/788] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:29.101518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.177081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75070ea5-915e-41cb-accf-d128e4271bbe None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.177381 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75070ea5-915e-41cb-accf-d128e4271bbe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.177641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75070ea5-915e-41cb-accf-d128e4271bbe None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.179022 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 402/789] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:29.186982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928bf2-3de5-439f-8474-6f171a1aaed9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.187261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928bf2-3de5-439f-8474-6f171a1aaed9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.187527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74928bf2-3de5-439f-8474-6f171a1aaed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.219859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-74928bf2-3de5-439f-8474-6f171a1aaed9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:29.222164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74928bf2-3de5-439f-8474-6f171a1aaed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:29.286125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893bf0e-4597-4279-a1e6-bd2f01b8d523 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.356801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 403/790] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:29.357478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.362230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.362526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.362808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.374886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.376353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:29.396736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:29.397766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:29.398721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:29.398721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:29.398721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:29.398721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 388/791] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:29.403819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74928bf2-3de5-439f-8474-6f171a1aaed9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.520364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.538030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74928bf2-3de5-439f-8474-6f171a1aaed9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.588143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.589524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.589864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.590143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.590793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:29.591097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.592469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.604467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 404/792] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:29.610438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.634358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.693224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.795141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef728-6ba2-4401-a3e5-92582253da5d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.849470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45021843-1edd-4f6f-b467-111dc16e49f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.850130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45021843-1edd-4f6f-b467-111dc16e49f2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.850410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45021843-1edd-4f6f-b467-111dc16e49f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.850683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45021843-1edd-4f6f-b467-111dc16e49f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.855942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d7a2f-c4ab-4f76-ad94-b4ebd45c3322 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.858335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45021843-1edd-4f6f-b467-111dc16e49f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.859791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45021843-1edd-4f6f-b467-111dc16e49f2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-45021843-1edd-4f6f-b467-111dc16e49f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:29.871563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:29.873691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:29.876103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 389/793] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:29.879700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3e34e-c28c-45e1-a883-e41c7ca0cd00 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.879700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3e34e-c28c-45e1-a883-e41c7ca0cd00 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.879700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3e34e-c28c-45e1-a883-e41c7ca0cd00 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.880434 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 390/794] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:29.881985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3e34e-c28c-45e1-a883-e41c7ca0cd00 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.892372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9195d-343a-4614-b9f8-75c55d3953cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.893032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9195d-343a-4614-b9f8-75c55d3953cb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.893426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9195d-343a-4614-b9f8-75c55d3953cb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.893758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9195d-343a-4614-b9f8-75c55d3953cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.905455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9195d-343a-4614-b9f8-75c55d3953cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8bc9195d-343a-4614-b9f8-75c55d3953cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:29.911423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:29.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 405/795] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:29.916061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7fb6-7b3f-44da-bdd0-f603702274ae None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.917692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7fb6-7b3f-44da-bdd0-f603702274ae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.917692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7fb6-7b3f-44da-bdd0-f603702274ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.937620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6a7b7fb6-7b3f-44da-bdd0-f603702274ae None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:29.938853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6a7b7fb6-7b3f-44da-bdd0-f603702274ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:29.941200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.967473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.996351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3e34e-c28c-45e1-a883-e41c7ca0cd00 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.022323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 406/796] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:30.022323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b7fb6-7b3f-44da-bdd0-f603702274ae None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.041310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5488d4-543d-4cc4-94f2-1e26012736b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.042376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5488d4-543d-4cc4-94f2-1e26012736b5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.042827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5488d4-543d-4cc4-94f2-1e26012736b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.043306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5488d4-543d-4cc4-94f2-1e26012736b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.044245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5488d4-543d-4cc4-94f2-1e26012736b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:30.044792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5488d4-543d-4cc4-94f2-1e26012736b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.046290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5488d4-543d-4cc4-94f2-1e26012736b5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.065052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 391/797] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:30.066321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d7878-c949-4af4-ba40-d6e99b389d4b None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.066608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d7878-c949-4af4-ba40-d6e99b389d4b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.066881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d7878-c949-4af4-ba40-d6e99b389d4b None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.068486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 392/798] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:30.069183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d7878-c949-4af4-ba40-d6e99b389d4b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.149749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b7fb6-7b3f-44da-bdd0-f603702274ae None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.178178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d7878-c949-4af4-ba40-d6e99b389d4b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.187538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d01ce-5f41-43c3-904e-57ea79586d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.188259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d01ce-5f41-43c3-904e-57ea79586d63 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.188544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d01ce-5f41-43c3-904e-57ea79586d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.188817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d01ce-5f41-43c3-904e-57ea79586d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.189595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d01ce-5f41-43c3-904e-57ea79586d63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:30.189940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d01ce-5f41-43c3-904e-57ea79586d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.191313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d01ce-5f41-43c3-904e-57ea79586d63 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.197028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.207191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 407/799] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:30.208567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7080c1-79a6-4d77-8289-e1dc2d5d5af4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.208856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7080c1-79a6-4d77-8289-e1dc2d5d5af4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.209180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7080c1-79a6-4d77-8289-e1dc2d5d5af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.216965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacf753-0869-4988-9ae5-e8cdc1eec82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.217694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf753-0869-4988-9ae5-e8cdc1eec82e None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.218008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf753-0869-4988-9ae5-e8cdc1eec82e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.218285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf753-0869-4988-9ae5-e8cdc1eec82e None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/36a184d53f1e4ebaaf55beee0f889bd8/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.220194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacf753-0869-4988-9ae5-e8cdc1eec82e None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=36a184d53f1e4ebaaf55beee0f889bd8, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.221634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacf753-0869-4988-9ae5-e8cdc1eec82e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.224032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.229860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3a7080c1-79a6-4d77-8289-e1dc2d5d5af4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:30.231147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3a7080c1-79a6-4d77-8289-e1dc2d5d5af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:30.245980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 393/800] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:30 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/36a184d53f1e4ebaaf55beee0f889bd8/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:30.247280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacf753-0869-4988-9ae5-e8cdc1eec82e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.304889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 408/801] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:30.337369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7080c1-79a6-4d77-8289-e1dc2d5d5af4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.453540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacf753-0869-4988-9ae5-e8cdc1eec82e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.496132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.497108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.497608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.498101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.508964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.511226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.517555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7080c1-79a6-4d77-8289-e1dc2d5d5af4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:30.528017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:30.528991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:30.531825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:30.531825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:30.531825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:30.533672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 394/802] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:30.540315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.554991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.565136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.565769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.566080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.566352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.566938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.568312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:30.580638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:30.581646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:30.583432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 409/803] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:30.587623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.622770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.689576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b686652-8b3b-4639-bd83-e2f86d465383 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.716835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fd616-8893-4325-b9f6-5e88f02bc9b5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.727457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.728174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.728523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.728958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.729752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:30.730461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.731627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.746022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 395/804] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:30.747030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.763923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.765144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.765833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.766351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.767262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:30.767713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.769527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.776606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 410/805] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:30.777716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.853380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.862578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f83241-20ba-44b8-aed3-253b8bd8bfa6 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.871092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.902861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8157d-72a6-4fab-8960-2a6517c37dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.903494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8157d-72a6-4fab-8960-2a6517c37dfc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.903832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8157d-72a6-4fab-8960-2a6517c37dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.904049 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8157d-72a6-4fab-8960-2a6517c37dfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.907344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132ecd-6b75-4b0c-9a1e-c8f1f2698346 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.914637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8157d-72a6-4fab-8960-2a6517c37dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-f7e8157d-72a6-4fab-8960-2a6517c37dfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:30.920099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:30.921261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 396/806] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:30.922266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8157d-72a6-4fab-8960-2a6517c37dfc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.956205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa819a0-a4ff-4035-aaae-7bd2aeadf293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.956931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa819a0-a4ff-4035-aaae-7bd2aeadf293 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.957211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa819a0-a4ff-4035-aaae-7bd2aeadf293 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.957481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa819a0-a4ff-4035-aaae-7bd2aeadf293 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.965550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa819a0-a4ff-4035-aaae-7bd2aeadf293 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.967111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa819a0-a4ff-4035-aaae-7bd2aeadf293 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-dfa819a0-a4ff-4035-aaae-7bd2aeadf293 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:30.978121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:30.979697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:30.980699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 411/807] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:30.981943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf4a3-114b-4725-8933-da01a0e76e0d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.981943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf4a3-114b-4725-8933-da01a0e76e0d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.982212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf4a3-114b-4725-8933-da01a0e76e0d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.983492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 412/808] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:30.984095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf4a3-114b-4725-8933-da01a0e76e0d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.051530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8157d-72a6-4fab-8960-2a6517c37dfc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.087373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.088199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.088421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.088733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.089375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.089676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.091078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.100410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 397/809] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.100410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.102373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf4a3-114b-4725-8933-da01a0e76e0d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.121711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.138263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.142710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80330634-ca43-4876-84af-30274b7d04ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.143328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330634-ca43-4876-84af-30274b7d04ab None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.143612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330634-ca43-4876-84af-30274b7d04ab None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.143885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80330634-ca43-4876-84af-30274b7d04ab None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.144554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80330634-ca43-4876-84af-30274b7d04ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.144859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80330634-ca43-4876-84af-30274b7d04ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.146267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80330634-ca43-4876-84af-30274b7d04ab None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.155645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 413/810] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.156817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638f2b-7194-4580-8e6d-b04405db475c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.157101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638f2b-7194-4580-8e6d-b04405db475c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.157373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638f2b-7194-4580-8e6d-b04405db475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.176884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e6638f2b-7194-4580-8e6d-b04405db475c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:31.178112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e6638f2b-7194-4580-8e6d-b04405db475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:31.219666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e386f5-d9c6-4ee6-830d-c486b8f079e1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.250905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 414/811] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:31.251676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6638f2b-7194-4580-8e6d-b04405db475c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.264505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.265635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.266632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.267546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.268815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.269338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.271533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.303668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 398/812] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.303668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.373314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6638f2b-7194-4580-8e6d-b04405db475c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.384494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.409025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.412997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a23321-b0e6-41ba-8eff-9f5a9b2fcc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.413884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23321-b0e6-41ba-8eff-9f5a9b2fcc56 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.414377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23321-b0e6-41ba-8eff-9f5a9b2fcc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.414886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a23321-b0e6-41ba-8eff-9f5a9b2fcc56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.415765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a23321-b0e6-41ba-8eff-9f5a9b2fcc56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.418443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a23321-b0e6-41ba-8eff-9f5a9b2fcc56 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.421981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d4a6-6c27-4268-9545-9fb72bf212ff None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.454503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 415/813] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:31.456359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a23321-b0e6-41ba-8eff-9f5a9b2fcc56 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.496075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.497268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.497544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.497816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.523731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.523731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:31.559901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:31.560936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:31.561832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:31.561832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:31.561832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:31.562476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 399/814] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:31.563090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.627418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a23321-b0e6-41ba-8eff-9f5a9b2fcc56 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.665582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7069-602c-4f8d-aed2-0716d14689da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.667588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7069-602c-4f8d-aed2-0716d14689da None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.668187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7069-602c-4f8d-aed2-0716d14689da None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.669222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7069-602c-4f8d-aed2-0716d14689da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.688892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f16fd-575d-4577-87dd-282e432ceb04 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.712474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.735723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.736614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.736899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.737176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] PATH_INFO: `/v3/services/network` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.737767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.739864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.743515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:31.753821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:31.755036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:31.756075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:31.759967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 400/815] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:31.761013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.764454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7069-602c-4f8d-aed2-0716d14689da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.766444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7069-602c-4f8d-aed2-0716d14689da None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.892708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 416/816] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:31.892708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7069-602c-4f8d-aed2-0716d14689da None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.898730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354eaa2-77a3-4561-8c95-635f23894b53 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.935702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.936546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.936967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.937405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.938239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.938682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.940363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.953895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 401/817] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.955038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.984449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.022983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.036361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7069-602c-4f8d-aed2-0716d14689da None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.080394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b3021-c988-4585-ade6-094aac617330 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.093791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.094501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.094784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.095060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.095983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] RBAC: Adding query filter params (name=network) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.096292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.098850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.109995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 417/818] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:32.112356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.135043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.135757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.136098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.136369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.148535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.150012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:32.167955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:32.169048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:32.170018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:32.170018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:32.170018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:32.173889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 402/819] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:32.175149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.245278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98a543-3ad6-4d31-86cf-6b6991910cdd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.278516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.280462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34a0c8-5944-44cf-90f7-14c2449461e0 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.285286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.286274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.286772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.287312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.295174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.298159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.299864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:32.313599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:32.314689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:32.315637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:32.319115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 418/820] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:32.320430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.329832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.330803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.331324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.331815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.332666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.333210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.335462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.350146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 403/821] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:32.350146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.450525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f34c-f5e7-483c-8e1e-4dcc3254d454 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.471466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd05c86-5c70-4a17-8370-82802a3f4fa1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.490234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.491174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.491671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.492273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.493124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.493593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.495825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.507211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c19e9-ef8b-4f08-adaf-26391027bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.507814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c19e9-ef8b-4f08-adaf-26391027bfeb None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.508094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c19e9-ef8b-4f08-adaf-26391027bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.508365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c19e9-ef8b-4f08-adaf-26391027bfeb None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.509083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c19e9-ef8b-4f08-adaf-26391027bfeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.509385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c19e9-ef8b-4f08-adaf-26391027bfeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.509961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 419/822] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:32.510941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.511161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c19e9-ef8b-4f08-adaf-26391027bfeb None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.531697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 404/823] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:32.532875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ebbf1-a8aa-46ba-852b-d3e49e70eff5 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.533159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ebbf1-a8aa-46ba-852b-d3e49e70eff5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.533430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ebbf1-a8aa-46ba-852b-d3e49e70eff5 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.538840 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 405/824] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:32.539635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ebbf1-a8aa-46ba-852b-d3e49e70eff5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.572147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.583261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.626656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b2a05-fa08-4741-99d8-3cf2ed70cadc None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.660741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ebbf1-a8aa-46ba-852b-d3e49e70eff5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.663061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442392-5646-4720-b90a-2e7c391ed680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.663690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442392-5646-4720-b90a-2e7c391ed680 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.663974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442392-5646-4720-b90a-2e7c391ed680 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.664249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442392-5646-4720-b90a-2e7c391ed680 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.664928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a442392-5646-4720-b90a-2e7c391ed680 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.666634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a442392-5646-4720-b90a-2e7c391ed680 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.688102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 420/825] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:32.688942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442392-5646-4720-b90a-2e7c391ed680 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.721069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0dc44-9231-4a31-ae2c-4f0d964f467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.722154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dc44-9231-4a31-ae2c-4f0d964f467f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.722668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dc44-9231-4a31-ae2c-4f0d964f467f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.723212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dc44-9231-4a31-ae2c-4f0d964f467f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.732571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0dc44-9231-4a31-ae2c-4f0d964f467f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.734567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0dc44-9231-4a31-ae2c-4f0d964f467f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-81a0dc44-9231-4a31-ae2c-4f0d964f467f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:32.748156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:32.749270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:32.750412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:32.750412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:32.750412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:32.750412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:32.750412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:32.750412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:32.750412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:32.750412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:32.756939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 406/826] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:32.758539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95cfdb-671a-4768-b12d-1368051752de None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.758932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95cfdb-671a-4768-b12d-1368051752de None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.759306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95cfdb-671a-4768-b12d-1368051752de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.783194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-1d95cfdb-671a-4768-b12d-1368051752de None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:32.785516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1d95cfdb-671a-4768-b12d-1368051752de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:32.827010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442392-5646-4720-b90a-2e7c391ed680 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.836167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.878196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.878829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.880147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.880426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.895452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 407/827] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:32.896449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95cfdb-671a-4768-b12d-1368051752de None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.896568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.898244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:32.914207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:32.915457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:32.916584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:32.916584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:32.916584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:32.922150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 421/828] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:32.923817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.927894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.019182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95cfdb-671a-4768-b12d-1368051752de None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.037865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cfa72-9468-4ba8-a0ff-289e471d6e19 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.059939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.060826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.061300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.061723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.062607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:33.063056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.064841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.076833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.077581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.077994 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.078367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.079198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:33.079359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 408/829] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:33.079593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.081049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.086986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.105920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 422/830] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:33.109992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.130372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.187272 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.208790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f5e2-5360-47e5-9bf1-a2d4bd7d1b7e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.240818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37709051-99a3-4e5c-a85e-0b5d222776ee None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.247246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.248113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.248605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.249071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.250444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=38af4d5f21ae43b699d7890ce9534d29) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:33.250962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.253264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.259987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 409/831] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/role_assignments?user.id=38af4d5f21ae43b699d7890ce9534d29&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=cac8d7ae8325488684667d62304b0860 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:33.260889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.285938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.286957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.287418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.287945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.296811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.298573 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:33.311747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:33.312727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:33.313896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 423/832] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:33.320019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.405639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf0c1-2b85-4c6f-a414-ad26da8f5147 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.440809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.461816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646cf4-5cb3-44a5-ac1c-3e4e25d67368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.462503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646cf4-5cb3-44a5-ac1c-3e4e25d67368 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.462785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646cf4-5cb3-44a5-ac1c-3e4e25d67368 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.463201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646cf4-5cb3-44a5-ac1c-3e4e25d67368 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.477912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce646cf4-5cb3-44a5-ac1c-3e4e25d67368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:33.478429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2748c6-1d7a-4b34-9d88-19b88cd213b0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-ce646cf4-5cb3-44a5-ac1c-3e4e25d67368 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:33.484448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:33.485593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:33.486934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:33.491104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 410/833] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:33.497769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646cf4-5cb3-44a5-ac1c-3e4e25d67368 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.502753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.536015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86514ef-03df-48be-acdc-df3937ff0887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.536628 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86514ef-03df-48be-acdc-df3937ff0887 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.536909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86514ef-03df-48be-acdc-df3937ff0887 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.537181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86514ef-03df-48be-acdc-df3937ff0887 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.538011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86514ef-03df-48be-acdc-df3937ff0887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:33.538289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86514ef-03df-48be-acdc-df3937ff0887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.539849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86514ef-03df-48be-acdc-df3937ff0887 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.552701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 424/834] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:33.554041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051a9e-78f0-417b-bae8-99f3196942ab None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.554327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051a9e-78f0-417b-bae8-99f3196942ab None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.554599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051a9e-78f0-417b-bae8-99f3196942ab None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.555809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 425/835] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:33.559109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26051a9e-78f0-417b-bae8-99f3196942ab None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.620824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce646cf4-5cb3-44a5-ac1c-3e4e25d67368 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.657185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aa565-fe04-42ce-96e2-9bd62715e71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.657806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa565-fe04-42ce-96e2-9bd62715e71d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.658117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa565-fe04-42ce-96e2-9bd62715e71d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.658390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aa565-fe04-42ce-96e2-9bd62715e71d None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.659060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa565-fe04-42ce-96e2-9bd62715e71d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:33.659360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa565-fe04-42ce-96e2-9bd62715e71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.660733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aa565-fe04-42ce-96e2-9bd62715e71d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.670102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 411/836] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:33.671318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1ee6-3fd1-4b47-803f-3ca6eced9090 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.671604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1ee6-3fd1-4b47-803f-3ca6eced9090 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.671879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d1ee6-3fd1-4b47-803f-3ca6eced9090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.685230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26051a9e-78f0-417b-bae8-99f3196942ab None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.695420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-2e6d1ee6-3fd1-4b47-803f-3ca6eced9090 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:33.697774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2e6d1ee6-3fd1-4b47-803f-3ca6eced9090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:33.722407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc17788-5a9c-48a2-8c1e-3a030d05f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.723072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17788-5a9c-48a2-8c1e-3a030d05f7bf None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.723352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17788-5a9c-48a2-8c1e-3a030d05f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.723900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17788-5a9c-48a2-8c1e-3a030d05f7bf None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/4be8758e659641e6bf49f7cc60b5e2d9/roles/ea03b7919cca4616936c45ad11b68389` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.732763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.740032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc17788-5a9c-48a2-8c1e-3a030d05f7bf None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=4be8758e659641e6bf49f7cc60b5e2d9, role_id=ea03b7919cca4616936c45ad11b68389)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.741870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc17788-5a9c-48a2-8c1e-3a030d05f7bf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.756062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 426/837] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:33 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/4be8758e659641e6bf49f7cc60b5e2d9/roles/ea03b7919cca4616936c45ad11b68389 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:33.756850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc17788-5a9c-48a2-8c1e-3a030d05f7bf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.786334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.797994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 412/838] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:33.881954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc17788-5a9c-48a2-8c1e-3a030d05f7bf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.920224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.921163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.921594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.922055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.933416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.935218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:33.951481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:33.952681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:33.953807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:33.953807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:33.953807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:33.960091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 427/839] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:33.962968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d1ee6-3fd1-4b47-803f-3ca6eced9090 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.069826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d1ee6-3fd1-4b47-803f-3ca6eced9090 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.108982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.115365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.116001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.116299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.116558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.117211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:34.117517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.118936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.133557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 413/840] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:34.143120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.165491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.210044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.227122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7b485-eb50-4849-a200-e1764840e1c9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.263130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.263920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0f40-da2c-4d1c-8a98-cedede7a7fb4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.264365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.264850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.265357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.266196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.267810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:34.279356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:34.280426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:34.281366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:34.285234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 428/841] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:34.293999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.308368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.308998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.309284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.309561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.318015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.319584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:34.332478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:34.333456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:34.334448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:34.339342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 414/842] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:34.340566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.412593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323ed5f-834c-4bfc-b7f4-8963374e0cb5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.415406 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.459683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.461208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.461986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.462474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.463494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:34.463763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c10c4-7c18-49df-b18a-846835f0fd82 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.464234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.467046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.478017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 429/843] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:34.479041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.490678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.517033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.518278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.519134 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.519877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.520835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:34.521349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.524137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.547806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 415/844] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:34.553494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.607467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538f9c-70c2-4e10-b34b-0e4f7b36dd9b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.660320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.662934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.663866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.664432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.666586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:34.667375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.669608 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.671987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c038a72-2d93-4d36-8f9a-aa9580b0870c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.683095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 430/845] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:34.714065 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3403bb-7bf4-4ed9-aba4-48a5c6d7a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.714742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3403bb-7bf4-4ed9-aba4-48a5c6d7a605 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.715030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3403bb-7bf4-4ed9-aba4-48a5c6d7a605 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.715308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3403bb-7bf4-4ed9-aba4-48a5c6d7a605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.784209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.815269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3403bb-7bf4-4ed9-aba4-48a5c6d7a605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.816821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3403bb-7bf4-4ed9-aba4-48a5c6d7a605 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.931606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 416/846] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 15:27:34.937212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.976370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.051302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bda08-a202-4685-badd-85870b6fc6c4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.089120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.089938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.090326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.090706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.102127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.104398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:35.121234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:35.122694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:35.123591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:35.123591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:35.123591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:35.123591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 431/847] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:35.144967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3403bb-7bf4-4ed9-aba4-48a5c6d7a605 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.232209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.263305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3403bb-7bf4-4ed9-aba4-48a5c6d7a605 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.306985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf19b9-c8dc-4bca-97ec-d4230acdaec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.307715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf19b9-c8dc-4bca-97ec-d4230acdaec0 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.307998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf19b9-c8dc-4bca-97ec-d4230acdaec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.308282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf19b9-c8dc-4bca-97ec-d4230acdaec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.308929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf19b9-c8dc-4bca-97ec-d4230acdaec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:35.309232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf19b9-c8dc-4bca-97ec-d4230acdaec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.310645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf19b9-c8dc-4bca-97ec-d4230acdaec0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.323491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 417/848] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:35.329272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.369478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ccb2f-f577-4087-a344-7a9342052e99 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.369984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ccb2f-f577-4087-a344-7a9342052e99 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.370271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ccb2f-f577-4087-a344-7a9342052e99 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.371874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 418/849] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:35.376889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803f5f-bc70-4aa1-a8a5-c94b737378f6 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.377184 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803f5f-bc70-4aa1-a8a5-c94b737378f6 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.377460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803f5f-bc70-4aa1-a8a5-c94b737378f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.397388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-22803f5f-bc70-4aa1-a8a5-c94b737378f6 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:35.398627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-22803f5f-bc70-4aa1-a8a5-c94b737378f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:35.431602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.450950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52382b0a-671c-453a-8c7f-76658ffcf1fd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.479899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 419/850] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:35.496976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.498035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.498515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.498982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.506796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.508605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:35.520823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:35.521712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:35.522659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:35.522659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:35.522659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:35.522659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:35.522659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:35.522659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:35.522659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:35.522659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:35.529646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 432/851] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:35.531293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803f5f-bc70-4aa1-a8a5-c94b737378f6 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.599312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.643103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803f5f-bc70-4aa1-a8a5-c94b737378f6 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.678980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.680390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.680867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.681370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.683173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:35.683708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.685665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.703959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 420/852] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:35.705697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.755110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.815040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177b79c-e9b7-4add-9b92-be76720df78c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.856735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f1228-3d57-4bfd-b605-4bf6e6dca585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.857339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f1228-3d57-4bfd-b605-4bf6e6dca585 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.857614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f1228-3d57-4bfd-b605-4bf6e6dca585 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.857909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f1228-3d57-4bfd-b605-4bf6e6dca585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.858634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f1228-3d57-4bfd-b605-4bf6e6dca585 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=36a184d53f1e4ebaaf55beee0f889bd8) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:35.858935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f1228-3d57-4bfd-b605-4bf6e6dca585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.860447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f1228-3d57-4bfd-b605-4bf6e6dca585 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.870048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 433/853] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/role_assignments?user.id=36a184d53f1e4ebaaf55beee0f889bd8&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=cac8d7ae8325488684667d62304b0860 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:35.870212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71701135-0c5e-4085-a130-28c759a21c5b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.870296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224db6-48a4-4ab2-9f06-f967749ab238 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.870296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224db6-48a4-4ab2-9f06-f967749ab238 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.870296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224db6-48a4-4ab2-9f06-f967749ab238 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.870784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 434/854] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:35.879556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345fcc3-4a3f-4a0b-83ed-81440fdb4988 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.879896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345fcc3-4a3f-4a0b-83ed-81440fdb4988 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.880247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345fcc3-4a3f-4a0b-83ed-81440fdb4988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.899213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.902162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5345fcc3-4a3f-4a0b-83ed-81440fdb4988 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:35.903589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5345fcc3-4a3f-4a0b-83ed-81440fdb4988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:35.906112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.912952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.913739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.914147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.915027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.915459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.917593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:35.927251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:35.928356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:35.929259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 421/855] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:35.939700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.997868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 435/856] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:36.059003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3cd3-070d-47a7-b0db-0240be5d8936 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.093955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.094565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.094842 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.095113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.095804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:36.096108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.097530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.102571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 422/857] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:36.110539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345fcc3-4a3f-4a0b-83ed-81440fdb4988 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.215821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345fcc3-4a3f-4a0b-83ed-81440fdb4988 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.252089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.252711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.252992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.253266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.253925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:36.254234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.255600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.260722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 436/858] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:36.280142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.342940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.398417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18046382-a7a7-469e-8700-0255f05daeae None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.435606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fb0d0-4242-4dea-b567-4bd25e542f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.436615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb0d0-4242-4dea-b567-4bd25e542f03 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.437061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb0d0-4242-4dea-b567-4bd25e542f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.437338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb0d0-4242-4dea-b567-4bd25e542f03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.449152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fb0d0-4242-4dea-b567-4bd25e542f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-f42fb0d0-4242-4dea-b567-4bd25e542f03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:36.454430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:36.455376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:36.456262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 423/859] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:36.461652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.465388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.568744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d04d9-1bdb-4fb0-96cf-1fe31ffa9508 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.605407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.605974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.606256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.606528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.607195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:36.607494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.608870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.617957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 437/860] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:36.623657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fb0d0-4242-4dea-b567-4bd25e542f03 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.736856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fb0d0-4242-4dea-b567-4bd25e542f03 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.751834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.774375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c502a95-291a-42eb-b7cb-f1808b363a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.775413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502a95-291a-42eb-b7cb-f1808b363a67 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.776402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502a95-291a-42eb-b7cb-f1808b363a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.776881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502a95-291a-42eb-b7cb-f1808b363a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.788201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c502a95-291a-42eb-b7cb-f1808b363a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.789977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c502a95-291a-42eb-b7cb-f1808b363a67 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-1c502a95-291a-42eb-b7cb-f1808b363a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:36.805215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:36.806277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:36.807512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:36.807512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:36.807512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:36.809225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 424/861] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:36.819126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.885753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.887116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2b7a-ee03-4536-89ae-e0c130f658fc None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.887381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2b7a-ee03-4536-89ae-e0c130f658fc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.887650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2b7a-ee03-4536-89ae-e0c130f658fc None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.888984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 425/862] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:36.894767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001b58-da04-42a9-9be6-2bdbd7a47213 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.895305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001b58-da04-42a9-9be6-2bdbd7a47213 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.895817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001b58-da04-42a9-9be6-2bdbd7a47213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.917312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-38001b58-da04-42a9-9be6-2bdbd7a47213 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:36.919291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-38001b58-da04-42a9-9be6-2bdbd7a47213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:36.937703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e6721-4bba-4da2-bfbf-dec9abbc4419 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.980358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.981400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.981903 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.982393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.983229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:36.983727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.985300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.999257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 438/863] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:37.004289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.008958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 426/864] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:37.133710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ed541-8bd1-4793-828d-5889c36c5262 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.163258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:37.176083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.176706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.176988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.177257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.185348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.186812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:37.203116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:37.204091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:37.205055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 439/865] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:37.211594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38001b58-da04-42a9-9be6-2bdbd7a47213 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.312371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:37.319050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.319732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38001b58-da04-42a9-9be6-2bdbd7a47213 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.369643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.370578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.370862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.371143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.371859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:37.372167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.373620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.396951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 427/866] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:37.399515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.446239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cf41d-fc83-4991-943c-939b058b536e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.483737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be360e-283c-46f8-8f9a-4bb972c0ce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.484502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be360e-283c-46f8-8f9a-4bb972c0ce4d None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.484983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be360e-283c-46f8-8f9a-4bb972c0ce4d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.485283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be360e-283c-46f8-8f9a-4bb972c0ce4d None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.486134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be360e-283c-46f8-8f9a-4bb972c0ce4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.487951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be360e-283c-46f8-8f9a-4bb972c0ce4d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.512976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 440/867] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:37 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:37.542835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b8f9f-7ffe-439c-a412-e8ac59bb214d None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.590743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a15e6-523a-43d6-871d-25240c16982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.591816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a15e6-523a-43d6-871d-25240c16982b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.592372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a15e6-523a-43d6-871d-25240c16982b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.592836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a15e6-523a-43d6-871d-25240c16982b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.614936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:37.676804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a15e6-523a-43d6-871d-25240c16982b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.678577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a15e6-523a-43d6-871d-25240c16982b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.789889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 428/868] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:37.792475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be360e-283c-46f8-8f9a-4bb972c0ce4d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.841935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:37.908494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be360e-283c-46f8-8f9a-4bb972c0ce4d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.910499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5515f9-5d3a-4db5-9adf-9766f2ab9c91 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.910795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5515f9-5d3a-4db5-9adf-9766f2ab9c91 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.911073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5515f9-5d3a-4db5-9adf-9766f2ab9c91 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.912568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 429/869] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:37.918250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f78a6-fdb9-42f9-a030-8210d85ddff2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.918537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f78a6-fdb9-42f9-a030-8210d85ddff2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.918813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f78a6-fdb9-42f9-a030-8210d85ddff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.938006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-487f78a6-fdb9-42f9-a030-8210d85ddff2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:37.939215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-487f78a6-fdb9-42f9-a030-8210d85ddff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:37.946691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.947893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.948177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.948459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.963668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.965465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:37.984551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:37.985549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:37.986780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:37.986780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:37.986780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:37.986780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 441/870] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:37.993428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.994268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:38.020862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 430/871] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:38.099852 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:38.106834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8d8d-b41c-4a93-85fa-c08e95a79b43 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.157248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.158254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.158820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.159308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.160201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:38.160706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.162367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.180464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 442/872] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:38.182237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f78a6-fdb9-42f9-a030-8210d85ddff2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.289694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f78a6-fdb9-42f9-a030-8210d85ddff2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.294722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.327056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.327747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.328028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.328298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.335853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.336962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:38.349695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:38.350815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:38.357442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 431/873] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:38.359649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.410881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:38.419200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcfc6a-5675-42c4-a1b7-98d963168a14 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.455310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577a59-2583-47ad-b429-6a49b8e67a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.455938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577a59-2583-47ad-b429-6a49b8e67a1b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.456223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577a59-2583-47ad-b429-6a49b8e67a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.456498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577a59-2583-47ad-b429-6a49b8e67a1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.457074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577a59-2583-47ad-b429-6a49b8e67a1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.458605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577a59-2583-47ad-b429-6a49b8e67a1b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-01577a59-2583-47ad-b429-6a49b8e67a1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:38.467408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:38.468386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:38.469254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:38.473481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 443/874] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:38.474727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600967-b426-4ad8-8965-7a7862639d44 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.475011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600967-b426-4ad8-8965-7a7862639d44 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.475287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55600967-b426-4ad8-8965-7a7862639d44 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.476547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 444/875] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:38.477236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600967-b426-4ad8-8965-7a7862639d44 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.485918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b291e-e767-41da-88de-72ab1cb430b3 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.502430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:38.523321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2286e9-a66e-459b-aa3c-e73ccd42e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.523924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2286e9-a66e-459b-aa3c-e73ccd42e234 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.524206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2286e9-a66e-459b-aa3c-e73ccd42e234 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.524476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2286e9-a66e-459b-aa3c-e73ccd42e234 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.525178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2286e9-a66e-459b-aa3c-e73ccd42e234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:38.525629 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2286e9-a66e-459b-aa3c-e73ccd42e234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.527309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2286e9-a66e-459b-aa3c-e73ccd42e234 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.546727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 432/876] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:38.546727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb791df7-7558-47c4-914f-d52b48b172af None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.546727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb791df7-7558-47c4-914f-d52b48b172af None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.546727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb791df7-7558-47c4-914f-d52b48b172af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.562877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-fb791df7-7558-47c4-914f-d52b48b172af None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:38.564056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fb791df7-7558-47c4-914f-d52b48b172af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:38.596906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55600967-b426-4ad8-8965-7a7862639d44 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.632668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 433/877] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:38.633787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb791df7-7558-47c4-914f-d52b48b172af None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.642614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.643418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.643793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.644168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.645016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:38.645421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.646904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.658114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 445/878] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:38.659109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.666504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:38.749586 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb791df7-7558-47c4-914f-d52b48b172af None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.771800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:38.790729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.792600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.793059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.793476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.794376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=4be8758e659641e6bf49f7cc60b5e2d9) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:38.794818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73100e-a28a-41fc-97d2-ddf86776f266 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.795000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.796714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.806730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 434/879] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/role_assignments?user.id=4be8758e659641e6bf49f7cc60b5e2d9&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:38.841832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac57f3-f506-47c1-8090-35039422d3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.842488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac57f3-f506-47c1-8090-35039422d3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.842770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac57f3-f506-47c1-8090-35039422d3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.843050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac57f3-f506-47c1-8090-35039422d3b1 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.843680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac57f3-f506-47c1-8090-35039422d3b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:38.843987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac57f3-f506-47c1-8090-35039422d3b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.845390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac57f3-f506-47c1-8090-35039422d3b1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.851391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 446/880] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:38.950658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:39.055542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:39.065905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609367a-c370-4726-822d-336f1f4816bf None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:39.102260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccb8d0-ed11-4014-9a60-8a7d2021e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:39.102882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb8d0-ed11-4014-9a60-8a7d2021e5f9 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.103156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb8d0-ed11-4014-9a60-8a7d2021e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.103982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccb8d0-ed11-4014-9a60-8a7d2021e5f9 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.104643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccb8d0-ed11-4014-9a60-8a7d2021e5f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:39.106049 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccb8d0-ed11-4014-9a60-8a7d2021e5f9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:39.128364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 435/881] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:38 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:39.629713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7e0a-a9f7-42c6-952b-0aea647ede18 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.630257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7e0a-a9f7-42c6-952b-0aea647ede18 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.630342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7e0a-a9f7-42c6-952b-0aea647ede18 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.631899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 447/882] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:39.637401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9244da-fe19-4545-9e71-7758fb2b4a0b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.637698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9244da-fe19-4545-9e71-7758fb2b4a0b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.638025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9244da-fe19-4545-9e71-7758fb2b4a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.657755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-bf9244da-fe19-4545-9e71-7758fb2b4a0b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:39.658984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bf9244da-fe19-4545-9e71-7758fb2b4a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:39.733249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 436/883] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:40.009368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7e0a-a9f7-42c6-952b-0aea647ede18 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.122690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7e0a-a9f7-42c6-952b-0aea647ede18 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.158247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.158876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.159159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.159431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.160009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.161375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:40.170888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:40.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:40.173602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 448/884] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:40.179312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9244da-fe19-4545-9e71-7758fb2b4a0b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.260739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.287311 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9244da-fe19-4545-9e71-7758fb2b4a0b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.322879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.323665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.323949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.324227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.324885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:40.325194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.326697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.332736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 437/885] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:40.339368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.355826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.450204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5760b1-6e05-42a4-864e-d706da808c10 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.609155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.609771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.610073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.610348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.610987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:40.611548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.612996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.618698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 449/886] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:40.626963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.737961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff4a60-9568-45f0-8826-384985f49486 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.773864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1ea3b-6b73-4292-9418-9ed44cfe4080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.774468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ea3b-6b73-4292-9418-9ed44cfe4080 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.774746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ea3b-6b73-4292-9418-9ed44cfe4080 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.775018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ea3b-6b73-4292-9418-9ed44cfe4080 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.775750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1ea3b-6b73-4292-9418-9ed44cfe4080 None admin] RBAC: Adding query filter params (interface=public, service_id=25f90c2167834e1abc65725c41df61aa, region_id=RegionOne) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:40.776056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1ea3b-6b73-4292-9418-9ed44cfe4080 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.777428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1ea3b-6b73-4292-9418-9ed44cfe4080 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.783050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 438/887] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/endpoints?service_id=25f90c2167834e1abc65725c41df61aa&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:40.791532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.866246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3dcff-8be5-4f4d-876b-f647ba87063a None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.866545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3dcff-8be5-4f4d-876b-f647ba87063a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.866713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3dcff-8be5-4f4d-876b-f647ba87063a None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.872760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 439/888] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:40.879465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98d86-9924-4c1d-8c1a-d34123f74eac None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.879747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98d86-9924-4c1d-8c1a-d34123f74eac None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.880021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98d86-9924-4c1d-8c1a-d34123f74eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.884752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.899606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.913781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-87d98d86-9924-4c1d-8c1a-d34123f74eac None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:40.915363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-87d98d86-9924-4c1d-8c1a-d34123f74eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:40.924293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812dd85-56d1-4452-8b53-1ae5a4a46020 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.965534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95036593-2823-43ef-822f-f7e5948e24c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.966184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036593-2823-43ef-822f-f7e5948e24c4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.966463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036593-2823-43ef-822f-f7e5948e24c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.966738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036593-2823-43ef-822f-f7e5948e24c4 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.967341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95036593-2823-43ef-822f-f7e5948e24c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.968721 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95036593-2823-43ef-822f-f7e5948e24c4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.982412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 450/889] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:27:40.993124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddfbb-0510-424d-ad3d-f0bd70384419 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.993472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddfbb-0510-424d-ad3d-f0bd70384419 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.993683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ddfbb-0510-424d-ad3d-f0bd70384419 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.996750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 451/890] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:41.002332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cfdb4-c40a-4c16-9372-51b87a55dd72 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.002651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cfdb4-c40a-4c16-9372-51b87a55dd72 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.002882 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cfdb4-c40a-4c16-9372-51b87a55dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.017879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 440/891] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:41.028787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9d4cfdb4-c40a-4c16-9372-51b87a55dd72 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:41.028787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9d4cfdb4-c40a-4c16-9372-51b87a55dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:41.105233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 452/892] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:41.245898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99e2e-f633-4b3c-8082-f144cd8927ce None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.246668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99e2e-f633-4b3c-8082-f144cd8927ce None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.246953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99e2e-f633-4b3c-8082-f144cd8927ce None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.248595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 441/893] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:41.253857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8091-200e-4b70-aa6f-78faf033793f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.254154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8091-200e-4b70-aa6f-78faf033793f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.254430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b8091-200e-4b70-aa6f-78faf033793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.273177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1d9b8091-200e-4b70-aa6f-78faf033793f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:41.274408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d9b8091-200e-4b70-aa6f-78faf033793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:41.288171 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99e2e-f633-4b3c-8082-f144cd8927ce None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.341459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.346530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 453/894] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:41.401599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b8091-200e-4b70-aa6f-78faf033793f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.414971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99e2e-f633-4b3c-8082-f144cd8927ce None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.454098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17766938-752b-462c-b63f-60a8362c659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.455081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17766938-752b-462c-b63f-60a8362c659c None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.455604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17766938-752b-462c-b63f-60a8362c659c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.456033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17766938-752b-462c-b63f-60a8362c659c None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.456830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17766938-752b-462c-b63f-60a8362c659c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.458511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17766938-752b-462c-b63f-60a8362c659c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.465106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.481612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 442/895] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:41 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:41.519840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b8091-200e-4b70-aa6f-78faf033793f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.567684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6468ee-801b-4434-a366-532278ff5d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.568386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6468ee-801b-4434-a366-532278ff5d27 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.568716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6468ee-801b-4434-a366-532278ff5d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.568991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6468ee-801b-4434-a366-532278ff5d27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.581766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6468ee-801b-4434-a366-532278ff5d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-eb6468ee-801b-4434-a366-532278ff5d27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:41.586739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:41.587881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:41.588762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 454/896] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:41.596122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17766938-752b-462c-b63f-60a8362c659c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.637385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6468ee-801b-4434-a366-532278ff5d27 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.721909 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17766938-752b-462c-b63f-60a8362c659c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.746231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.765801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6468ee-801b-4434-a366-532278ff5d27 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.766285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.766903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.767185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.767728 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.769323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:41.769644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.771070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.782982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 443/897] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:41.787986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.811590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.813038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.813887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.814311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.815039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.817089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:41.829709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:41.830905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:41.832037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:41.835511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 455/898] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:41.841712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.866186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.912064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f4b05-7ff4-4ed0-aaaa-a563f599b08a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.950416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.951066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.951604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.951740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.963323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.964805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.979446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29563ad8-e741-4dee-a8ec-6d81ed357160 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:41.980246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:41.981217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:41.982153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:41.982153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:41.982153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:41.982153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 444/899] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:41.987356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.007222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.030032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.031060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.031351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.031916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.032536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.032836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.034676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.039883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 456/900] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:42.048876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.127558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c670e-fa61-4e40-a136-4a9e98de63fc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.144072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.167803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa60e1-3640-44a5-bc3d-47ce70f00325 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.180523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.181688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.182159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.182866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.184162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.184771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.186717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.205211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 445/901] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:42.214169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.216065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.216727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.217013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.217290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.217950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.218257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.219913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.230728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 457/902] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:42.231678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.285902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.328499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f266b67-e7be-4c64-96ac-c47c5bff1673 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.348174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc7d24-ace2-4695-b9c1-c75cb40b2780 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.366421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.367180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.367554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.367923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.375507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.377061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.385252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.385869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.386189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.386467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.387165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] RBAC: Adding query filter params (interface=public, service_id=a17dd030c4724444a648d800b22640f7, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.387472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.388834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:42.391990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:42.393186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:42.394483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:42.400854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 446/903] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:42.401242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 458/904] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/endpoints?service_id=a17dd030c4724444a648d800b22640f7&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:42.401926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.402190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.436082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.510188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe8b1d-d171-42be-baa0-90c35f45a11a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.513970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef449-8821-4081-8a61-641378e08aad None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.523590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.547501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677fe19-c75f-4ba5-b4df-a30734c7321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.548388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677fe19-c75f-4ba5-b4df-a30734c7321c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.548832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677fe19-c75f-4ba5-b4df-a30734c7321c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.549340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677fe19-c75f-4ba5-b4df-a30734c7321c None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.550223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677fe19-c75f-4ba5-b4df-a30734c7321c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.551952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677fe19-c75f-4ba5-b4df-a30734c7321c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.552531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.553214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.553557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.554003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.554805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.555174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.557389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.570168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 459/905] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:27:42.578662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 447/906] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:42.584602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677fe19-c75f-4ba5-b4df-a30734c7321c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.704093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677fe19-c75f-4ba5-b4df-a30734c7321c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.741309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ea89d-4c82-4583-8589-04900c35b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.742196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea89d-4c82-4583-8589-04900c35b320 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.742647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea89d-4c82-4583-8589-04900c35b320 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.743089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ea89d-4c82-4583-8589-04900c35b320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.795612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.821047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ea89d-4c82-4583-8589-04900c35b320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.823721 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ea89d-4c82-4583-8589-04900c35b320 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.952131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 460/907] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:42.957766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.030078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ea1f8-727a-41f2-b6ee-3c40b4435fe7 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.030405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ea1f8-727a-41f2-b6ee-3c40b4435fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.030625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ea1f8-727a-41f2-b6ee-3c40b4435fe7 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.032216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 461/908] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:43.037456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0d3b-567d-470f-81eb-238225ce3247 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.037742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0d3b-567d-470f-81eb-238225ce3247 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.038048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d0d3b-567d-470f-81eb-238225ce3247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.058927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.067756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-231d0d3b-567d-470f-81eb-238225ce3247 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:43.069218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-231d0d3b-567d-470f-81eb-238225ce3247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:43.074454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632a9d-c5a0-4049-9667-d021d0968c7b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.111180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.112444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.112928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.113413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.127468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.129170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:43.151616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:43.152656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:43.158590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:43.158590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:43.158590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:43.158778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 462/909] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:43.160230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 448/910] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:43.165043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0d3b-567d-470f-81eb-238225ce3247 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.178202 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.285613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d0d3b-567d-470f-81eb-238225ce3247 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.321067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.321588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.321887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.322799 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.323751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:43.324053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.325419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.337018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 463/911] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:43.342952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.445294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.455097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba4261-8dd0-49a1-9b25-fd2309b2ff06 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.493804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4462f-8025-4b37-a82a-1ffee7d0c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.495512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4462f-8025-4b37-a82a-1ffee7d0c08a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.496016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4462f-8025-4b37-a82a-1ffee7d0c08a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.496495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4462f-8025-4b37-a82a-1ffee7d0c08a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.504290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4462f-8025-4b37-a82a-1ffee7d0c08a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.506127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4462f-8025-4b37-a82a-1ffee7d0c08a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.510251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b2d4462f-8025-4b37-a82a-1ffee7d0c08a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:43.521355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:43.522424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:43.523359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:43.523359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:43.523359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:43.523359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:43.523359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:43.523359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:43.523359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:43.523359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:43.525915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 449/912] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:43.527447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338041d-d39f-4a08-8e63-c7b6541fb209 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.527940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338041d-d39f-4a08-8e63-c7b6541fb209 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.528476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338041d-d39f-4a08-8e63-c7b6541fb209 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.530170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 450/913] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:43.531416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338041d-d39f-4a08-8e63-c7b6541fb209 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.531955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.577080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8bcc-7a4d-44b3-af82-8433ded1a69b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.614099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee74a3-2b8d-48d2-89c0-18cca7ef780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.614728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee74a3-2b8d-48d2-89c0-18cca7ef780c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.615005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee74a3-2b8d-48d2-89c0-18cca7ef780c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.615271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee74a3-2b8d-48d2-89c0-18cca7ef780c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.615837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee74a3-2b8d-48d2-89c0-18cca7ef780c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.617180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee74a3-2b8d-48d2-89c0-18cca7ef780c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-91ee74a3-2b8d-48d2-89c0-18cca7ef780c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:43.626434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:43.627511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:43.628695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 464/914] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:43.629526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3992630-ddb6-4d0a-bac1-82dcadebf98a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.629526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3992630-ddb6-4d0a-bac1-82dcadebf98a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.629526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3992630-ddb6-4d0a-bac1-82dcadebf98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.644912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338041d-d39f-4a08-8e63-c7b6541fb209 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.648072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d3992630-ddb6-4d0a-bac1-82dcadebf98a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:43.649312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d3992630-ddb6-4d0a-bac1-82dcadebf98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:43.683451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.684060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.684337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.684606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.685389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:43.685646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.687385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.700251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 451/915] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:43.700251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.725356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 465/916] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:43.726266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3992630-ddb6-4d0a-bac1-82dcadebf98a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.777587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.806225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.829560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08104c06-7a6b-43c1-867e-5529c022620c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.833250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3992630-ddb6-4d0a-bac1-82dcadebf98a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.867256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.868305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.868883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.869396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.869655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.870203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.870555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.870891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:43.870997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.871490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.871758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] RBAC: Adding query filter params (role.id=de815dab8d1d44f183230021499df564, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=4be8758e659641e6bf49f7cc60b5e2d9) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:43.872135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.873442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.873676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.879155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 452/917] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:43.885109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 466/918] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/role_assignments?user.id=4be8758e659641e6bf49f7cc60b5e2d9&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=de815dab8d1d44f183230021499df564 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:43.886621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.004443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7e3c-ffc3-4335-b32b-9ad760033874 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.006362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.037143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:44.058337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.059205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.059566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.059913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.060684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:44.061079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.062515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.067742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 453/919] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:44.074432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.146205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecb070-aede-458e-be69-0eeabc66dbb5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.172590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:44.185565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.186553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.187058 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.187554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.188358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.190043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:44.200048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:44.201170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:44.202134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:44.203992 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95bd6-7fff-4354-80cd-518845d57dcb None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.205416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 467/920] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:44.211575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.250908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53988be-02a9-46bf-8503-f9fa90e06d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.252008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53988be-02a9-46bf-8503-f9fa90e06d28 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.252589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53988be-02a9-46bf-8503-f9fa90e06d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.253066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53988be-02a9-46bf-8503-f9fa90e06d28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.254003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53988be-02a9-46bf-8503-f9fa90e06d28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.255612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53988be-02a9-46bf-8503-f9fa90e06d28 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.283980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 454/921] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:44.337547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097fc64-16d1-4a92-ac0f-42ccf1c48b29 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.387847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.388374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.388652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.388916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.389546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:44.389859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.391333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.397210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 468/922] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:44.404224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53988be-02a9-46bf-8503-f9fa90e06d28 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.460832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:44.523628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53988be-02a9-46bf-8503-f9fa90e06d28 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.559463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d855e-57a2-4b08-89ba-26abce6fead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.560138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d855e-57a2-4b08-89ba-26abce6fead0 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.560425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d855e-57a2-4b08-89ba-26abce6fead0 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.560712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d855e-57a2-4b08-89ba-26abce6fead0 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.561350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d855e-57a2-4b08-89ba-26abce6fead0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:44.561652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d855e-57a2-4b08-89ba-26abce6fead0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.563063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d855e-57a2-4b08-89ba-26abce6fead0 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.568474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 455/923] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:44.574248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.607166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b729fa9-5164-4c54-b1ef-7ed138d10d9a None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.607473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b729fa9-5164-4c54-b1ef-7ed138d10d9a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.607722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b729fa9-5164-4c54-b1ef-7ed138d10d9a None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.609305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 456/924] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:44.614479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feefe5a-3d13-4edd-b9fd-da1fadadd4f9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.614766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feefe5a-3d13-4edd-b9fd-da1fadadd4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.615042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feefe5a-3d13-4edd-b9fd-da1fadadd4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.626930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:44.636308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8feefe5a-3d13-4edd-b9fd-da1fadadd4f9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:44.637745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8feefe5a-3d13-4edd-b9fd-da1fadadd4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:44.689034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faa9f9-a530-4feb-b9a2-51093be3b4c2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.727786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 457/925] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:44.730514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.731232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.731611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.731979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.732788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] RBAC: Adding query filter params (interface=public, service_id=2f66e9f88f6247fe8c046ab7f6a38fb0, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:44.733195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.734738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.741085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 469/926] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:44 2022] GET /identity/v3/endpoints?service_id=2f66e9f88f6247fe8c046ab7f6a38fb0&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:44.746754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feefe5a-3d13-4edd-b9fd-da1fadadd4f9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.787934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:44.852447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feefe5a-3d13-4edd-b9fd-da1fadadd4f9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.888609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7aaa3-de31-42e6-84f8-019e6727be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.889245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7aaa3-de31-42e6-84f8-019e6727be9f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.889528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7aaa3-de31-42e6-84f8-019e6727be9f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.889802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7aaa3-de31-42e6-84f8-019e6727be9f None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.891969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7aaa3-de31-42e6-84f8-019e6727be9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.893363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7aaa3-de31-42e6-84f8-019e6727be9f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.900825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 458/927] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:44 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:27:45.031973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.153097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ae418-ff5b-4793-8eec-262f358d29ba None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.166935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:45.189851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.190501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.190824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.191106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.191684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.193048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:45.202293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:45.204787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:45.206358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 470/928] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:45.209578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7aaa3-de31-42e6-84f8-019e6727be9f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.313982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7aaa3-de31-42e6-84f8-019e6727be9f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.315479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:45.350060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.350669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.350949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.351219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.351847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:45.352147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.354104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.359140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 459/929] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:45.364970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.472611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31328b6-41cc-4e8b-b57a-125769c4caa9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.512337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b237f-6a7b-48ca-8ee6-4654a3acf120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.512949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b237f-6a7b-48ca-8ee6-4654a3acf120 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.513226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b237f-6a7b-48ca-8ee6-4654a3acf120 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.513502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b237f-6a7b-48ca-8ee6-4654a3acf120 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.514213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b237f-6a7b-48ca-8ee6-4654a3acf120 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:45.514515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b237f-6a7b-48ca-8ee6-4654a3acf120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.515935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b237f-6a7b-48ca-8ee6-4654a3acf120 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.521482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 471/930] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:45.527542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.636227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2e897-3861-4d02-bdf5-db5d6cf361a5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.671794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4250-b0d3-4a05-b7f6-35f17f1e49e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.672398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4250-b0d3-4a05-b7f6-35f17f1e49e2 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.672678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4250-b0d3-4a05-b7f6-35f17f1e49e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.672946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4250-b0d3-4a05-b7f6-35f17f1e49e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.673610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4250-b0d3-4a05-b7f6-35f17f1e49e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.675017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4250-b0d3-4a05-b7f6-35f17f1e49e2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.699120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 460/931] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:45.914044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe603-cea1-462a-9eb1-0efaad7317df None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.914418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe603-cea1-462a-9eb1-0efaad7317df None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.914607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe603-cea1-462a-9eb1-0efaad7317df None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.916622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 472/932] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:45.922058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219881-7b88-4614-9e89-ca7ee6ef5f42 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.922346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219881-7b88-4614-9e89-ca7ee6ef5f42 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.922624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219881-7b88-4614-9e89-ca7ee6ef5f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.941500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-84219881-7b88-4614-9e89-ca7ee6ef5f42 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:45.942728 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-84219881-7b88-4614-9e89-ca7ee6ef5f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:45.964333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.025449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 461/933] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:46.299177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffe603-cea1-462a-9eb1-0efaad7317df None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.345591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.408940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffe603-cea1-462a-9eb1-0efaad7317df None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.443424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7c31-d4f6-43e0-b218-41fc9425e31a None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.444131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7c31-d4f6-43e0-b218-41fc9425e31a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.444454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f8f6c-ec2c-42a5-bd94-b3799297ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.444845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d7c31-d4f6-43e0-b218-41fc9425e31a None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.445079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f8f6c-ec2c-42a5-bd94-b3799297ea22 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.445361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f8f6c-ec2c-42a5-bd94-b3799297ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.445636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f8f6c-ec2c-42a5-bd94-b3799297ea22 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.451938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 462/934] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:46.453914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e46f5-be72-49d8-a641-22e3f1157380 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.454432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e46f5-be72-49d8-a641-22e3f1157380 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.454922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e46f5-be72-49d8-a641-22e3f1157380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.458434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f8f6c-ec2c-42a5-bd94-b3799297ea22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2d4f8f6c-ec2c-42a5-bd94-b3799297ea22 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:46.464209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:46.465181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:46.466064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:46.468375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 473/935] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:46.474434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f8f6c-ec2c-42a5-bd94-b3799297ea22 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.476012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-6c0e46f5-be72-49d8-a641-22e3f1157380 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:46.477365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6c0e46f5-be72-49d8-a641-22e3f1157380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:46.570019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 463/936] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:46.592500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.596188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f8f6c-ec2c-42a5-bd94-b3799297ea22 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.641258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.642219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.642651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.643185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.643997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:46.644450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.645990 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.655640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 474/937] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:46.662959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e46f5-be72-49d8-a641-22e3f1157380 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.750225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.769596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e46f5-be72-49d8-a641-22e3f1157380 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.805399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.806070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.806382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.806663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.817498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.819353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:46.836818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:46.838581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:46.839473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:46.839473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:46.839473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:46.839473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 464/938] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:46.844473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.872404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.973160 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802dd7d-f252-4669-b582-d227b5347ea4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.991143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b28f9-527a-44a8-9cb6-751ac85865ef None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.009077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.009904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.010191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.010512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.011107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:47.011410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.012783 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.026114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.026277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 475/939] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:47.031464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.034595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.035413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.035903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.036379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.037249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.038920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.043095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING keystone.server.flask.common [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 15:27:47.060320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.062254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.sql.core [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 15:27:47.062254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 15:27:47.062254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [parameters: {'id': 'f007b004246c4a33a8f66772c84eccd8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 15:27:47.062254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81828) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-9ea3ff89-cce8-43b9-8228-4a9562820f54 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f007b004246c4a33a8f66772c84eccd8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f007b004246c4a33a8f66772c84eccd8. Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:27:47.069722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application result.read() Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 15:27:47.070581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application yield resource Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise self.value Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application session.commit() Aug 26 15:27:47.071554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.session.flush() Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application compat.raise_( Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 15:27:47.072658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 15:27:47.073564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application result.read() Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:27:47.076016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [parameters: {'id': 'f007b004246c4a33a8f66772c84eccd8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.082526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:47.086177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f007b004246c4a33a8f66772c84eccd8. Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 465/940] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Aug 26 15:27:46 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e515-52d5-483f-848b-426ec98fdaee None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.088972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e515-52d5-483f-848b-426ec98fdaee None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.090584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e515-52d5-483f-848b-426ec98fdaee None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.090584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 466/941] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:47.090584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1e515-52d5-483f-848b-426ec98fdaee None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.158692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eddec-d7fd-4db2-ad0e-1b6cd9f80609 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.196021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37ba38-47cb-4f09-b37b-a81df71022f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.197123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37ba38-47cb-4f09-b37b-a81df71022f6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.197611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37ba38-47cb-4f09-b37b-a81df71022f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.198445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37ba38-47cb-4f09-b37b-a81df71022f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.200912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1e515-52d5-483f-848b-426ec98fdaee None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.206538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37ba38-47cb-4f09-b37b-a81df71022f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.208223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37ba38-47cb-4f09-b37b-a81df71022f6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fe37ba38-47cb-4f09-b37b-a81df71022f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:47.221909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:47.223090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:47.224123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 476/942] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:47.224853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0455d5b-43fe-4ac6-b74f-a016f5280153 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.225144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0455d5b-43fe-4ac6-b74f-a016f5280153 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.225481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0455d5b-43fe-4ac6-b74f-a016f5280153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.244479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.245032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a0455d5b-43fe-4ac6-b74f-a016f5280153 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:47.245176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.245386 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.245660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.246280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a0455d5b-43fe-4ac6-b74f-a016f5280153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:47.253009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.254625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:47.269833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:47.272649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 467/943] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:47.273575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.330419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.333221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 477/944] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:47.334534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0455d5b-43fe-4ac6-b74f-a016f5280153 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.353648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.411888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973028b-8c38-4d63-b1b4-2e8698d4488a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.457198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.457952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.458381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.458713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.459530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:47.459909 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.461473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.468235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0455d5b-43fe-4ac6-b74f-a016f5280153 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.486791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 468/945] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:47.488996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.522217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.522916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.523262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.523599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.524329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:47.524697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.527049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.546006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 478/946] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:47.622606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.626115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8aa7f-067f-4d7e-b027-bbdaa711a59e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.630878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.684766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d7616-3be0-498a-8029-97f4abe442c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.685603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7616-3be0-498a-8029-97f4abe442c4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.686023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7616-3be0-498a-8029-97f4abe442c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.686400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d7616-3be0-498a-8029-97f4abe442c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.698016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7616-3be0-498a-8029-97f4abe442c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.699985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d7616-3be0-498a-8029-97f4abe442c4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-810d7616-3be0-498a-8029-97f4abe442c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:47.717532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:47.718584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:47.719490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:47.719490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:47.719490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:47.719490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 469/947] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:47.720181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7724b-32a6-466f-b510-6a67874abf36 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.720464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7724b-32a6-466f-b510-6a67874abf36 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.720734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7724b-32a6-466f-b510-6a67874abf36 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.721512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.725536 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 470/948] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:47.727901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c46a6-1a3f-4ca1-8ae3-d756553133ba None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.729051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c46a6-1a3f-4ca1-8ae3-d756553133ba None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.729625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c46a6-1a3f-4ca1-8ae3-d756553133ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.747985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-df1c46a6-1a3f-4ca1-8ae3-d756553133ba None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:47.749474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-df1c46a6-1a3f-4ca1-8ae3-d756553133ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:47.755462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8daf96-86ee-4438-8cf4-10b43e02f7ca None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.795883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.796512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.796787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.797054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.797633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.799067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:47.809468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:47.810703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:47.811689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 479/949] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:47.812647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.836289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 471/950] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:47.837400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c46a6-1a3f-4ca1-8ae3-d756553133ba None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.932197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba898d77-a27d-44c2-b9b5-4392f9fcf8c3 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.939038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.957371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c46a6-1a3f-4ca1-8ae3-d756553133ba None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.969883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.970824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.971297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.971748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.972566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:47.973047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.974659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.977437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.989641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 480/951] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:47.995591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.003374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.004766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.005239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.005694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.007015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:48.007506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.010551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.022728 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 472/952] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:48.023445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.113011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb25d0-672a-4715-b889-fdd2edbd22cb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.155157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.155786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.156068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.156337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.163026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190da64-6af1-4470-8a46-28c361183b15 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.163825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.165252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:48.176970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:48.177965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 481/953] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:48.180727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.211620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.212387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.213883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.214193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.215094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:48.215399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.217691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.228545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 473/954] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:48.228545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.242997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:48.248130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:48.294377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb95e-70b3-486f-b467-a4b529a20a34 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.328583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.329206 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.329483 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.329750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.330352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.331720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:48.342704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:48.344484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:48.345660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:48.348812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 482/955] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:48.349621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.351191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e03ca-eb6c-46e1-b1a5-83cf5801877f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.390891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.391718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.392076 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.392415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.393175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:48.393554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.395231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.413330 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 474/956] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:48.413330 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.460732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab77a66-a8fd-46fc-aabf-b5279bd8ef3e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.483760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:48.494673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:48.501517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d667-e092-48b4-9dc5-6701842d6981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.502223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d667-e092-48b4-9dc5-6701842d6981 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.502570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d667-e092-48b4-9dc5-6701842d6981 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.502931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d667-e092-48b4-9dc5-6701842d6981 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.503654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045d667-e092-48b4-9dc5-6701842d6981 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.505011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045d667-e092-48b4-9dc5-6701842d6981 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.533873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c826d4-78dc-4406-8e4c-804c9d7e1270 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.534094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 483/957] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:48.534094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d667-e092-48b4-9dc5-6701842d6981 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.585208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.586387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.586975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.587262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.588241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:48.588857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.590691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.600943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 475/958] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:48.607006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.656838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d667-e092-48b4-9dc5-6701842d6981 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.694976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c189d45-dbb8-49f0-9192-6fd728b530b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.695930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c189d45-dbb8-49f0-9192-6fd728b530b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.696379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c189d45-dbb8-49f0-9192-6fd728b530b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.696809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c189d45-dbb8-49f0-9192-6fd728b530b5 None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/4be8758e659641e6bf49f7cc60b5e2d9/roles/de815dab8d1d44f183230021499df564` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.700038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c189d45-dbb8-49f0-9192-6fd728b530b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=4be8758e659641e6bf49f7cc60b5e2d9, role_id=de815dab8d1d44f183230021499df564)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.701553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c189d45-dbb8-49f0-9192-6fd728b530b5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.719538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 484/959] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:48 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/4be8758e659641e6bf49f7cc60b5e2d9/roles/de815dab8d1d44f183230021499df564 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:48.769081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055215-8033-4105-92c7-882eba4201d7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.807963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d01c7c-5616-4bbf-a9e7-d8ba283d1548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.808583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d01c7c-5616-4bbf-a9e7-d8ba283d1548 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.808868 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d01c7c-5616-4bbf-a9e7-d8ba283d1548 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.809143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d01c7c-5616-4bbf-a9e7-d8ba283d1548 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.809786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d01c7c-5616-4bbf-a9e7-d8ba283d1548 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:48.810124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d01c7c-5616-4bbf-a9e7-d8ba283d1548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.811534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d01c7c-5616-4bbf-a9e7-d8ba283d1548 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.813013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:48.825355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 476/960] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:49.590924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a501b-e46d-460f-bc3f-1034af3fa0f5 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.591898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a501b-e46d-460f-bc3f-1034af3fa0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.592380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a501b-e46d-460f-bc3f-1034af3fa0f5 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.594216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 485/961] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:49.599989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e0c93-5500-47a3-92ba-1e97988cabcd None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.600528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e0c93-5500-47a3-92ba-1e97988cabcd None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.601007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e0c93-5500-47a3-92ba-1e97988cabcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.620334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c00e0c93-5500-47a3-92ba-1e97988cabcd None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:49.621880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c00e0c93-5500-47a3-92ba-1e97988cabcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:49.701981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 477/962] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:49.973732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a501b-e46d-460f-bc3f-1034af3fa0f5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.013403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.083819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a501b-e46d-460f-bc3f-1034af3fa0f5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.120279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.121222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.121788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.122286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.123190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.124841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.127707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING keystone.server.flask.common [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 15:27:50.142814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.sql.core [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 15:27:50.142814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 15:27:50.142814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [parameters: {'user_id': '88c4ec1307594cd28c8dcc56eb8f357d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 15:27:50.142814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81827) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Aug 26 15:27:50.160684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:27:50.161615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application yield resource Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise self.value Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application session.commit() Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 15:27:50.162649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.flush() Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application compat.raise_( Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 15:27:50.163580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:27:50.164507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:27:50.165428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [parameters: {'user_id': '88c4ec1307594cd28c8dcc56eb8f357d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:50.166501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 15:27:50.167337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 15:27:50.168299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 15:27:50.168299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 15:27:50.168299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 15:27:50.168299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 15:27:50.168299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 15:27:50.168299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:50.168299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 486/963] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 15:27:49 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:50.168704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e0c93-5500-47a3-92ba-1e97988cabcd None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.277347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e0c93-5500-47a3-92ba-1e97988cabcd None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.312002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.320222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c9c9f-bfdf-4e2d-a454-1d2a4dfb7186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.320909 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9c9f-bfdf-4e2d-a454-1d2a4dfb7186 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.321190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9c9f-bfdf-4e2d-a454-1d2a4dfb7186 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.321464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9c9f-bfdf-4e2d-a454-1d2a4dfb7186 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.329437 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9c9f-bfdf-4e2d-a454-1d2a4dfb7186 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.330955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9c9f-bfdf-4e2d-a454-1d2a4dfb7186 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-c81c9c9f-bfdf-4e2d-a454-1d2a4dfb7186 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:50.344552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:50.347340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:50.349543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:50.350826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 478/964] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:50.357873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.462065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96732-47e8-49fa-b322-762e2247d77e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.479494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.499838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb09803-af8f-4f9b-9971-34c6507362da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.500456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09803-af8f-4f9b-9971-34c6507362da None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.500742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09803-af8f-4f9b-9971-34c6507362da None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.501047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb09803-af8f-4f9b-9971-34c6507362da None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.501869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09803-af8f-4f9b-9971-34c6507362da None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:50.502209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09803-af8f-4f9b-9971-34c6507362da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.503928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb09803-af8f-4f9b-9971-34c6507362da None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.550132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 487/965] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:50.617936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d502c-60fb-4c9b-b7f8-0ea3dbc191a6 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.618285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d502c-60fb-4c9b-b7f8-0ea3dbc191a6 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.618473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d502c-60fb-4c9b-b7f8-0ea3dbc191a6 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.620699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 479/966] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:50.626076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a009-385c-4513-9f0b-6a3448c2908a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.626677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a009-385c-4513-9f0b-6a3448c2908a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.626677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8a009-385c-4513-9f0b-6a3448c2908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.647080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bac8a009-385c-4513-9f0b-6a3448c2908a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:50.648766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bac8a009-385c-4513-9f0b-6a3448c2908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:50.736975 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 488/967] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:50.764990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d67d8f-51ed-4cfd-a005-d80e445f23a0 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.765251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d67d8f-51ed-4cfd-a005-d80e445f23a0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.765587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d67d8f-51ed-4cfd-a005-d80e445f23a0 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.766917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 480/968] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:50.773062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdaefe-67d1-401e-a53e-594e43a2af18 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.773402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdaefe-67d1-401e-a53e-594e43a2af18 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.773692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdaefe-67d1-401e-a53e-594e43a2af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.792908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-defdaefe-67d1-401e-a53e-594e43a2af18 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:50.794160 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-defdaefe-67d1-401e-a53e-594e43a2af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:50.847417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e5d1-e8a6-4a01-9847-56a909f192bc None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.847704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e5d1-e8a6-4a01-9847-56a909f192bc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.847704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e5d1-e8a6-4a01-9847-56a909f192bc None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.849959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 481/969] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:50.854750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba079-5639-43f7-8ef2-ce8b14d0db5f None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.855109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba079-5639-43f7-8ef2-ce8b14d0db5f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.855451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba079-5639-43f7-8ef2-ce8b14d0db5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.867896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 489/970] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:50.874484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e89ba079-5639-43f7-8ef2-ce8b14d0db5f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:50.875845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e89ba079-5639-43f7-8ef2-ce8b14d0db5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:50.944136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 482/971] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:51.031690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdaefe-67d1-401e-a53e-594e43a2af18 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.050307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.142667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdaefe-67d1-401e-a53e-594e43a2af18 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.145079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba079-5639-43f7-8ef2-ce8b14d0db5f None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.183370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.184001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.184279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.184547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.185125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.186527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:51.195272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:51.196281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:51.197222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 490/972] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:51.202798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.257135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba079-5639-43f7-8ef2-ce8b14d0db5f None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.273984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.283641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.292907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524f4c-9424-4bb2-9ee4-eef3da4ad770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.293542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524f4c-9424-4bb2-9ee4-eef3da4ad770 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.293825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524f4c-9424-4bb2-9ee4-eef3da4ad770 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.294144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524f4c-9424-4bb2-9ee4-eef3da4ad770 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.303759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f5ec4-1021-4c6b-8591-74ef6cd2b5f5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.304045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb524f4c-9424-4bb2-9ee4-eef3da4ad770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-cb524f4c-9424-4bb2-9ee4-eef3da4ad770 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:51.309577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:51.310712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:51.311583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 483/973] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:51.312362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524f4c-9424-4bb2-9ee4-eef3da4ad770 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.340546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.341153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.341426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.341701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.342344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:51.342646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.344002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.348605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 491/974] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:51.349372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.415498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524f4c-9424-4bb2-9ee4-eef3da4ad770 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.449383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a3c23-81cf-4908-b857-b1d216aaf918 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.450273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c55043-2af5-421f-90f9-0f461e805ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.450882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c55043-2af5-421f-90f9-0f461e805ad4 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.451226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c55043-2af5-421f-90f9-0f461e805ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.451502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c55043-2af5-421f-90f9-0f461e805ad4 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.452139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c55043-2af5-421f-90f9-0f461e805ad4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.453515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c55043-2af5-421f-90f9-0f461e805ad4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.468178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 484/975] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:51 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:51.469172 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c55043-2af5-421f-90f9-0f461e805ad4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.498383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.499009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.499288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.499589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.500260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:51.500562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.501989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.517596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 492/976] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:51.517803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.519490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.522756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.590901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c55043-2af5-421f-90f9-0f461e805ad4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.629855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.630468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.630744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.631015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.631642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:51.631942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.633319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.639935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 485/977] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:51.642749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b69ddf-77ff-4d90-91c5-884bc925d9fd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.647885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.679297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.679852 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.680135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.680406 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.691813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.693421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:51.711948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:51.713734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:51.718989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:51.718989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:51.718989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:51.718989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 493/978] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:51.720308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.762823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd40233-9755-42cb-91dc-bdf45a887eca None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.764538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.780351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.802256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.802949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.803298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.803664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.804513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] RBAC: Adding query filter params (interface=admin, service_id=2f66e9f88f6247fe8c046ab7f6a38fb0, region_id=RegionOne) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:51.804900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.807160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.813450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 486/979] 10.222.0.20 () {56 vars in 1249 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/endpoints?service_id=2f66e9f88f6247fe8c046ab7f6a38fb0&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:51.818566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.831019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2749975-5367-41aa-afab-fe9f65f8d9c5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.867015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.867806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.868093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.868369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.869109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:51.869523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.870938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.885145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 494/980] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:51.890479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.924159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7611127-594a-49de-ac18-0549a65969ea None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.960804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283f19-addf-4671-b4fd-38f54543aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.961582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283f19-addf-4671-b4fd-38f54543aa11 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.961997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283f19-addf-4671-b4fd-38f54543aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.963180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15283f19-addf-4671-b4fd-38f54543aa11 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.963824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15283f19-addf-4671-b4fd-38f54543aa11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.965268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15283f19-addf-4671-b4fd-38f54543aa11 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.982117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 487/981] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:27:52.004950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1f86-fba9-4785-8d24-33a52c44357c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:52.021773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:52.045973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:52.046770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.047182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.047564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.055798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:52.057867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:52.073831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:52.075024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:52.076131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 495/982] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:52.081898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283f19-addf-4671-b4fd-38f54543aa11 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:52.117195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:52.196036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15283f19-addf-4671-b4fd-38f54543aa11 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:52.231539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:52.232443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.232955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.233421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.234368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:52.234876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:52.236755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:52.255285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 488/983] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:52.261488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:52.370642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f0082-a26f-440e-8a8d-87f9a3162e82 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:52.406167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177c086-d19e-4764-a575-33a64013f21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:52.407157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177c086-d19e-4764-a575-33a64013f21e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.407635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177c086-d19e-4764-a575-33a64013f21e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.408100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177c086-d19e-4764-a575-33a64013f21e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.453046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:52.480540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177c086-d19e-4764-a575-33a64013f21e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:52.482572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177c086-d19e-4764-a575-33a64013f21e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:52.583915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 496/984] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:52.590098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:52.678101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:52.691168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4812e08-b472-4d78-bea4-a0fd9b8ffb98 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:52.725904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:52.726533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.726813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.727098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.737638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:52.739057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:52.753424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:52.754456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:52.760771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:52.760771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:52.760771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:52.760771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 489/985] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:52.762632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177c086-d19e-4764-a575-33a64013f21e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:52.838213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:52.864085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177c086-d19e-4764-a575-33a64013f21e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:52.898138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:52.899007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.899468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.900558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.901404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:52.901905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:52.903450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:52.915500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 497/986] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:52.921239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.026990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693617f5-8222-41b8-9d06-01859812f4dc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.060932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.061570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.061871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.062160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.069054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.070566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.074338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:53.085885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:53.087010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:53.088010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:53.088010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:53.088010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:53.088010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:53.088010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:53.088010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:53.088010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:53.088010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:53.090721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 490/987] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:53.096492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.214831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324676e6-e78c-426b-8986-cc6d7fa68492 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.248204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73127a-0089-4815-b84d-ebd41adc04d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.248808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73127a-0089-4815-b84d-ebd41adc04d6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.249087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73127a-0089-4815-b84d-ebd41adc04d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.249360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73127a-0089-4815-b84d-ebd41adc04d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.250076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73127a-0089-4815-b84d-ebd41adc04d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:53.250382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73127a-0089-4815-b84d-ebd41adc04d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.251809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73127a-0089-4815-b84d-ebd41adc04d6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.253379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:53.266481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 498/988] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:53.272404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.375328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1882834-5ee0-43ad-8681-770b72dc7463 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.413260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ea942-f8d3-41a3-8c9d-f3f96145ad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.413890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea942-f8d3-41a3-8c9d-f3f96145ad87 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.414178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea942-f8d3-41a3-8c9d-f3f96145ad87 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.414450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea942-f8d3-41a3-8c9d-f3f96145ad87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.415176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ea942-f8d3-41a3-8c9d-f3f96145ad87 None admin] RBAC: Adding query filter params (role.id=de815dab8d1d44f183230021499df564, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=4be8758e659641e6bf49f7cc60b5e2d9) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:53.415524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ea942-f8d3-41a3-8c9d-f3f96145ad87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.417052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ea942-f8d3-41a3-8c9d-f3f96145ad87 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.423307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 491/989] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:53 2022] GET /identity/v3/role_assignments?user.id=4be8758e659641e6bf49f7cc60b5e2d9&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=de815dab8d1d44f183230021499df564 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:53.426688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2430cd5-d524-455a-be64-248b1122da09 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.426976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2430cd5-d524-455a-be64-248b1122da09 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.427254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2430cd5-d524-455a-be64-248b1122da09 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.428784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 499/990] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:53.434642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa39c1-e20b-48a1-bf3c-54c68691903a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.434969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa39c1-e20b-48a1-bf3c-54c68691903a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.435191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa39c1-e20b-48a1-bf3c-54c68691903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.455266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4efa39c1-e20b-48a1-bf3c-54c68691903a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:53.456497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4efa39c1-e20b-48a1-bf3c-54c68691903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:53.523279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:53.534338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 492/991] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:53.804804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2430cd5-d524-455a-be64-248b1122da09 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.908419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2430cd5-d524-455a-be64-248b1122da09 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.942980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.943667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.943947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.944378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.944847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.945872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679bb2-8cdc-4c78-98e9-b1064e8c87bc None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.946303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679bb2-8cdc-4c78-98e9-b1064e8c87bc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.946399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.946482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679bb2-8cdc-4c78-98e9-b1064e8c87bc None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.948427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 493/992] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:53.953329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a6e0-e318-4bf3-8b9a-6c8982f5b18d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.953612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a6e0-e318-4bf3-8b9a-6c8982f5b18d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.953911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a6e0-e318-4bf3-8b9a-6c8982f5b18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:53.955524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:53.956473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:53.957346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 500/993] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:53.962135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.974888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-38c7a6e0-e318-4bf3-8b9a-6c8982f5b18d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:53.976387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-38c7a6e0-e318-4bf3-8b9a-6c8982f5b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:54.024928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:54.051564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 494/994] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:54.073639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b40919-221f-4823-9ae9-a0c4da17d886 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.107807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.108412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.108691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.108963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.109641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] RBAC: Adding query filter params (name=compute) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:54.109970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.111694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.116559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 501/995] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:54.122372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a6e0-e318-4bf3-8b9a-6c8982f5b18d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.224256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a6e0-e318-4bf3-8b9a-6c8982f5b18d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.248027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:54.260482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.261083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.261364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.261636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.262288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:54.262592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.263988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.269057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 495/996] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:54.274613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.330999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.378466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb14768-769f-4224-95ab-c62095a884be None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.404015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:54.419189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.419808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.420131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.420407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.421109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] RBAC: Adding query filter params (interface=public, service_id=d9998acae05548a9a8b390b076f23ca0, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:54.421416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.422867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.433490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 502/997] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/endpoints?service_id=d9998acae05548a9a8b390b076f23ca0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:54.434439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.456322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0b958-5ec4-44aa-8720-ed62cfe90d9e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.497910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.498547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.498828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.499102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.499678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.501044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:54.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:54.512278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:54.515011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 496/998] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:54.518137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.548059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89023881-d6db-4f72-b178-8cfea9a03f7b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.575290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:54.590414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c6bf-536b-49db-8c70-deb2e1f7190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.590952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c6bf-536b-49db-8c70-deb2e1f7190f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.591232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c6bf-536b-49db-8c70-deb2e1f7190f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.591505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c6bf-536b-49db-8c70-deb2e1f7190f None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.592115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c6bf-536b-49db-8c70-deb2e1f7190f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.593457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c6bf-536b-49db-8c70-deb2e1f7190f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.606285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 503/999] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:27:54.629235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c513b7-2ae7-456d-a5f2-137058802f56 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.668933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.669563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.669876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.670151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.670800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:54.671105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.672505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.682792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 497/1000] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:54.683871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c6bf-536b-49db-8c70-deb2e1f7190f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.752118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:54.805926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c6bf-536b-49db-8c70-deb2e1f7190f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.841741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80f37a-ade4-4d9a-adff-3dbe89ac40c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.842303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f37a-ade4-4d9a-adff-3dbe89ac40c6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.842586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f37a-ade4-4d9a-adff-3dbe89ac40c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.842860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f37a-ade4-4d9a-adff-3dbe89ac40c6 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.843487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80f37a-ade4-4d9a-adff-3dbe89ac40c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:54.843794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80f37a-ade4-4d9a-adff-3dbe89ac40c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.845152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80f37a-ade4-4d9a-adff-3dbe89ac40c6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.854907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 504/1001] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:54.856081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.960085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e6bcd-95f1-436f-b624-831c3f264d47 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.977050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:54.996100 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f48f4c-75cb-4b83-8e73-5271b3130022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.996765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f48f4c-75cb-4b83-8e73-5271b3130022 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.997051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f48f4c-75cb-4b83-8e73-5271b3130022 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.997326 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f48f4c-75cb-4b83-8e73-5271b3130022 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.998015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f48f4c-75cb-4b83-8e73-5271b3130022 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.999393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f48f4c-75cb-4b83-8e73-5271b3130022 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:55.022177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 498/1002] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:55.409707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797881c6-47b1-458d-a80c-1b8a9fcb50d6 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:55.410122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797881c6-47b1-458d-a80c-1b8a9fcb50d6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:55.410249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797881c6-47b1-458d-a80c-1b8a9fcb50d6 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:55.411722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 505/1003] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:55.416913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dec53-2e09-4b4e-bb33-61f1a0f6b30d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:55.417392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dec53-2e09-4b4e-bb33-61f1a0f6b30d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:55.417816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dec53-2e09-4b4e-bb33-61f1a0f6b30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:55.436567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ce9dec53-2e09-4b4e-bb33-61f1a0f6b30d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:55.437758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ce9dec53-2e09-4b4e-bb33-61f1a0f6b30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:55.514355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 499/1004] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:55.782196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797881c6-47b1-458d-a80c-1b8a9fcb50d6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:55.881188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797881c6-47b1-458d-a80c-1b8a9fcb50d6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:55.894558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:55.914922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:55.916143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:55.916464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:55.916734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] PATH_INFO: `/v3/services/image` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:55.917309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:55.918702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:55.927254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:55.928264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:55.929112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:27:55.936713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 506/1005] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 26 15:27:55 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:55.936846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dec53-2e09-4b4e-bb33-61f1a0f6b30d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:56.035676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dec53-2e09-4b4e-bb33-61f1a0f6b30d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:56.037128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:56.073625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb8cea-0af1-4b9f-af37-0114ca98b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:56.074281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8cea-0af1-4b9f-af37-0114ca98b019 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.074563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8cea-0af1-4b9f-af37-0114ca98b019 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.074835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8cea-0af1-4b9f-af37-0114ca98b019 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.075461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb8cea-0af1-4b9f-af37-0114ca98b019 None admin] RBAC: Adding query filter params (name=image) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:56.075768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb8cea-0af1-4b9f-af37-0114ca98b019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:56.077146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb8cea-0af1-4b9f-af37-0114ca98b019 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:56.086503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 500/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:56.088954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:56.203613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c836-89ce-4921-a9dc-65e0cbb53ffa None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:56.240030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92746ce7-2ea4-4386-9a8e-4c502da8b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:56.240630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746ce7-2ea4-4386-9a8e-4c502da8b66b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.240906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746ce7-2ea4-4386-9a8e-4c502da8b66b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.241176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92746ce7-2ea4-4386-9a8e-4c502da8b66b None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.241794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92746ce7-2ea4-4386-9a8e-4c502da8b66b None admin] RBAC: Adding query filter params (type=image) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:56.242122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92746ce7-2ea4-4386-9a8e-4c502da8b66b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:56.243470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92746ce7-2ea4-4386-9a8e-4c502da8b66b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:56.248535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 507/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:56.564734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bbee-fead-495a-8370-4608cac84c3b None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.565014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bbee-fead-495a-8370-4608cac84c3b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.565292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bbee-fead-495a-8370-4608cac84c3b None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.566672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 501/1008] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:56.572413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d1e2-1d4d-4be6-b30e-f54da46f44bd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.572755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d1e2-1d4d-4be6-b30e-f54da46f44bd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.573230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d1e2-1d4d-4be6-b30e-f54da46f44bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.592213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c867d1e2-1d4d-4be6-b30e-f54da46f44bd None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:56.593397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c867d1e2-1d4d-4be6-b30e-f54da46f44bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:56.636915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:56.673051 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 508/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:56.945469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9bbee-fead-495a-8370-4608cac84c3b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:56.993130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8cc4-7174-4143-a2d8-fb87da38e51e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.994325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8cc4-7174-4143-a2d8-fb87da38e51e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.994430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc8cc4-7174-4143-a2d8-fb87da38e51e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.996171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 509/1010] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:57.001254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6083-4584-4f2a-b9d5-08e314fb7ccd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:57.001542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6083-4584-4f2a-b9d5-08e314fb7ccd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:57.001817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6083-4584-4f2a-b9d5-08e314fb7ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:57.020459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-12bf6083-4584-4f2a-b9d5-08e314fb7ccd None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:57.021687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-12bf6083-4584-4f2a-b9d5-08e314fb7ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:57.052820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9bbee-fead-495a-8370-4608cac84c3b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:57.088356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:57.088987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:57.089268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:57.089540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:57.090160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:57.091527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:57.097789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 510/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:57.100195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:57.101309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:27:57.103597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 502/1012] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:57.107699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6083-4584-4f2a-b9d5-08e314fb7ccd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:57.219172 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6083-4584-4f2a-b9d5-08e314fb7ccd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:57.220763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:57.255926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:57.256535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:57.256810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:57.257078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:57.257704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:57.258031 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:57.259499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:57.269156 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 511/1013] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:57.270143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:57.301811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:57.370519 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:57.377035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f75a4-23a2-46a8-9bb1-51c78f041c7a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:57.413176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:57.413784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:57.414436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:57.414436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:57.415071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:57.415475 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:57.417414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:57.422952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 503/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:57.428632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:57.475447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b141359-4bff-4de6-8b63-e5b7b19f0ee2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:57.512005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8287af-48b3-4b92-9c79-8a6335909938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:57.512630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8287af-48b3-4b92-9c79-8a6335909938 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:57.512910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8287af-48b3-4b92-9c79-8a6335909938 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:57.513187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8287af-48b3-4b92-9c79-8a6335909938 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:57.514320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8287af-48b3-4b92-9c79-8a6335909938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:57.515730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8287af-48b3-4b92-9c79-8a6335909938 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:57.517471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 512/1015] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:57.522928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8287af-48b3-4b92-9c79-8a6335909938 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:57.534239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:57.543059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168d901-03c1-44f7-ac79-143ac08094c3 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:57.560401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:57.588012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977bcb8-899c-4627-94da-1e3fb6493a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:57.588948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977bcb8-899c-4627-94da-1e3fb6493a81 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:57.589235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977bcb8-899c-4627-94da-1e3fb6493a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:57.589508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977bcb8-899c-4627-94da-1e3fb6493a81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:57.590365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977bcb8-899c-4627-94da-1e3fb6493a81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:57.592301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977bcb8-899c-4627-94da-1e3fb6493a81 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:57.618104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 504/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:57.630649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8287af-48b3-4b92-9c79-8a6335909938 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:57.675985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89cc62-05b0-4435-906e-c803be446e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:57.676615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89cc62-05b0-4435-906e-c803be446e9f None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:57.676893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89cc62-05b0-4435-906e-c803be446e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:57.677163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89cc62-05b0-4435-906e-c803be446e9f None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:57.677812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89cc62-05b0-4435-906e-c803be446e9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:57.679336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89cc62-05b0-4435-906e-c803be446e9f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:57.717947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 513/1017] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:57 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:58.213675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2418-7ad6-4640-bd85-b368dfbf92c5 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.214225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2418-7ad6-4640-bd85-b368dfbf92c5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.214345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2418-7ad6-4640-bd85-b368dfbf92c5 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.215657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 505/1018] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:58.221025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5b0b-5c3e-4766-ab54-cb31ddb18ee6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.221438 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5b0b-5c3e-4766-ab54-cb31ddb18ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.221605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5b0b-5c3e-4766-ab54-cb31ddb18ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.240144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-385d5b0b-5c3e-4766-ab54-cb31ddb18ee6 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:58.241340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-385d5b0b-5c3e-4766-ab54-cb31ddb18ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:58.311625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 514/1019] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:58 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:58.592373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f2418-7ad6-4640-bd85-b368dfbf92c5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:58.698682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f2418-7ad6-4640-bd85-b368dfbf92c5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:58.733526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a323908-965e-4f4b-b5c0-3fbe6db43d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:58.734175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323908-965e-4f4b-b5c0-3fbe6db43d85 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.734460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323908-965e-4f4b-b5c0-3fbe6db43d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.734733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323908-965e-4f4b-b5c0-3fbe6db43d85 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.735388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a323908-965e-4f4b-b5c0-3fbe6db43d85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:58.737333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a323908-965e-4f4b-b5c0-3fbe6db43d85 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:58.754324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 506/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:58 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:59.663670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5890b-72e8-48d1-ab37-dc57000ad18b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.664238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5890b-72e8-48d1-ab37-dc57000ad18b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.664238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5890b-72e8-48d1-ab37-dc57000ad18b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.666009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 515/1021] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:59.671079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dddf5-869e-42bb-a6f1-fc2c8103bd5e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.671482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dddf5-869e-42bb-a6f1-fc2c8103bd5e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.671672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dddf5-869e-42bb-a6f1-fc2c8103bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.690241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ff3dddf5-869e-42bb-a6f1-fc2c8103bd5e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:59.691432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ff3dddf5-869e-42bb-a6f1-fc2c8103bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:59.694355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:59.737691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c8fa-669d-4a27-9aed-2692b328ef52 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.738021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c8fa-669d-4a27-9aed-2692b328ef52 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.738281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c8fa-669d-4a27-9aed-2692b328ef52 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.739694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 516/1022] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:59.745524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9656e3-fcb0-4c5c-ab99-22d7a07d2576 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.745763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9656e3-fcb0-4c5c-ab99-22d7a07d2576 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.746080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9656e3-fcb0-4c5c-ab99-22d7a07d2576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.764776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ad9656e3-fcb0-4c5c-ab99-22d7a07d2576 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:59.766006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ad9656e3-fcb0-4c5c-ab99-22d7a07d2576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:59.773766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:59.778048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 507/1023] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:59.838269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 517/1024] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:00.043145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dddf5-869e-42bb-a6f1-fc2c8103bd5e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.112724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9656e3-fcb0-4c5c-ab99-22d7a07d2576 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.152487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dddf5-869e-42bb-a6f1-fc2c8103bd5e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.190876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e9281-6b44-4ab5-897c-803f2ae9daf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.191510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9281-6b44-4ab5-897c-803f2ae9daf4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.191783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9281-6b44-4ab5-897c-803f2ae9daf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.192051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9281-6b44-4ab5-897c-803f2ae9daf4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.195428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.205671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e9281-6b44-4ab5-897c-803f2ae9daf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-d72e9281-6b44-4ab5-897c-803f2ae9daf4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:00.210363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:00.211559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:00.213075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 508/1025] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:00.218110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e9281-6b44-4ab5-897c-803f2ae9daf4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.226475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9656e3-fcb0-4c5c-ab99-22d7a07d2576 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.264243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ada93-0c99-42c8-8f2a-9b37a8d4a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.264874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ada93-0c99-42c8-8f2a-9b37a8d4a998 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.265154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ada93-0c99-42c8-8f2a-9b37a8d4a998 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.265424 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ada93-0c99-42c8-8f2a-9b37a8d4a998 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.266544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ada93-0c99-42c8-8f2a-9b37a8d4a998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.267977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ada93-0c99-42c8-8f2a-9b37a8d4a998 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.269936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 518/1026] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:00.275773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ada93-0c99-42c8-8f2a-9b37a8d4a998 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.288141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.331376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e9281-6b44-4ab5-897c-803f2ae9daf4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.368093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.368912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.369208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.369485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.370186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:00.370493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.371890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.380249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 509/1027] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:00.386599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.392201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ada93-0c99-42c8-8f2a-9b37a8d4a998 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.428997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6d425-9c76-4538-ad58-1621ca176bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.429611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6d425-9c76-4538-ad58-1621ca176bd1 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.429933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6d425-9c76-4538-ad58-1621ca176bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.430193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6d425-9c76-4538-ad58-1621ca176bd1 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.430833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6d425-9c76-4538-ad58-1621ca176bd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.433208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6d425-9c76-4538-ad58-1621ca176bd1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.451532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.457899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 519/1028] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:28:00 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:28:00.512833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58208c90-f111-4e7c-a910-7b0f12d65457 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.549548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481512e-de72-4d8b-b684-db9c4b14fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.550224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481512e-de72-4d8b-b684-db9c4b14fdb5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.550506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481512e-de72-4d8b-b684-db9c4b14fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.550778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481512e-de72-4d8b-b684-db9c4b14fdb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.562903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481512e-de72-4d8b-b684-db9c4b14fdb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.564392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481512e-de72-4d8b-b684-db9c4b14fdb5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-6481512e-de72-4d8b-b684-db9c4b14fdb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:00.581025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:00.582467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:00.583413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:00.583413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:00.583413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:00.586265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 510/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:00.588875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6d425-9c76-4538-ad58-1621ca176bd1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.661163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.709529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6d425-9c76-4538-ad58-1621ca176bd1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.744077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.745833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b941e1-894b-4f9e-887a-0a7534fd9354 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.746309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b941e1-894b-4f9e-887a-0a7534fd9354 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.746402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b941e1-894b-4f9e-887a-0a7534fd9354 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.746573 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.746811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.747096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.747880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 511/1030] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:00.748005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:00.748089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.749434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.752737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b63bbc-3ad3-4b8b-b80c-d55d32424b9b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.753019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b63bbc-3ad3-4b8b-b80c-d55d32424b9b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.753291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b63bbc-3ad3-4b8b-b80c-d55d32424b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.763094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 520/1031] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:00.768356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.775934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-f3b63bbc-3ad3-4b8b-b80c-d55d32424b9b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:00.777128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f3b63bbc-3ad3-4b8b-b80c-d55d32424b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:00.850659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 512/1032] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:00.879881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576150b-7c62-418e-b68b-4350c87f45d0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.907412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.917116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.917739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.918041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.918310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.925497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.926955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:28:00.938661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:00.939674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:00.945286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 521/1033] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:00.946437 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b63bbc-3ad3-4b8b-b80c-d55d32424b9b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.992213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.052617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b63bbc-3ad3-4b8b-b80c-d55d32424b9b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.086943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.087816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.088203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.088478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.089188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.089490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.090948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.108676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 513/1034] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:01.114328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.126137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.230899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0e46e-987f-4bc4-930a-deb54c978b55 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.234486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.238492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd01a5-641a-4420-a1c1-7a2a8c901d4a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.268099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6de46-7538-4c8f-8ae0-318fef9f041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.268702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6de46-7538-4c8f-8ae0-318fef9f041c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.268985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6de46-7538-4c8f-8ae0-318fef9f041c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.269256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6de46-7538-4c8f-8ae0-318fef9f041c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.275502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.276142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.276424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.276697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] PATH_INFO: `/v3/services/image` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.277279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.278701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:01.287867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:01.288910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:01.289770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 514/1035] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:01.295128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.330885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.346241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6de46-7538-4c8f-8ae0-318fef9f041c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.347715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6de46-7538-4c8f-8ae0-318fef9f041c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.404777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d734de-8a6e-4d0a-9a64-84ac93b74448 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.440558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.441163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.441440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.441710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.442361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] RBAC: Adding query filter params (name=image) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.443086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.444462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.450915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 515/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:01.460523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 522/1037] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:01.460695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.461483 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6de46-7538-4c8f-8ae0-318fef9f041c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.491912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.559383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.571752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23c018-7de6-4119-b8cd-c37db40e5e35 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.575022 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6de46-7538-4c8f-8ae0-318fef9f041c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.607085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.607821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.608171 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.608510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.609228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] RBAC: Adding query filter params (type=image) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.609659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.610389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.611109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.611295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.611792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.612133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.620793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 516/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:01.625571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.626300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.627117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:01.643105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:01.644118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:01.645083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:01.645083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:01.645083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:01.645083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 523/1039] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:01.651075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.722714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.733975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8526b16-7666-4160-8d44-cc0c03a99a13 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.755490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5026c-8f68-4126-b319-46ee7fffbcb4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.769742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.770422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.770709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.771003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.771699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] RBAC: Adding query filter params (interface=public, service_id=4fcc0de27814448eb02f5ba104b7ad43, region_id=RegionOne) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.772007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.773370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.783833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 517/1040] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/endpoints?service_id=4fcc0de27814448eb02f5ba104b7ad43&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:01.784797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.796071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.796676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.796956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.797225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.797864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.798186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.799541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.806761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.813293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 524/1041] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:01.818687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.892867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bba46-de9b-4d6d-ac73-d152820921be None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.928017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c14e-3cf9-4285-9c7e-b6e07208a44c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.929921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ec6c6-25f1-4f93-9edb-25f754c531ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.930531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec6c6-25f1-4f93-9edb-25f754c531ae None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.930810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec6c6-25f1-4f93-9edb-25f754c531ae None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.931622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec6c6-25f1-4f93-9edb-25f754c531ae None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.932219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ec6c6-25f1-4f93-9edb-25f754c531ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.933598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ec6c6-25f1-4f93-9edb-25f754c531ae None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.940269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 518/1042] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:28:01.968620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.969596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.970082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.970502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.978747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.980514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:28:01.994225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:01.995398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:01.996513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:28:01.996513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:28:01.996513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:28:01.996513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:28:01.996513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:28:01.996513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:28:01.996513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:01.996513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:01.998840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 525/1043] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:02.004601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ec6c6-25f1-4f93-9edb-25f754c531ae None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:02.026792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:02.122612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ec6c6-25f1-4f93-9edb-25f754c531ae None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:02.162724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eedce5-f09e-4bc2-892a-38ffcdaf7d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:02.163579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eedce5-f09e-4bc2-892a-38ffcdaf7d00 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.164032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eedce5-f09e-4bc2-892a-38ffcdaf7d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.164451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eedce5-f09e-4bc2-892a-38ffcdaf7d00 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.165357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eedce5-f09e-4bc2-892a-38ffcdaf7d00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:02.166031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eedce5-f09e-4bc2-892a-38ffcdaf7d00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:02.167605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eedce5-f09e-4bc2-892a-38ffcdaf7d00 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:02.180461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 519/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:02.186734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:02.248614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:02.292901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3994fed-7e51-4b49-981e-c32dc09ec67c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:02.326744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b580f-518a-4a9a-b0b0-b3f8e268e95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:02.327490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b580f-518a-4a9a-b0b0-b3f8e268e95e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.327873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b580f-518a-4a9a-b0b0-b3f8e268e95e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.328269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b580f-518a-4a9a-b0b0-b3f8e268e95e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.329097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b580f-518a-4a9a-b0b0-b3f8e268e95e None admin] RBAC: Adding query filter params (role.id=de815dab8d1d44f183230021499df564, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=38af4d5f21ae43b699d7890ce9534d29) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:02.329509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b580f-518a-4a9a-b0b0-b3f8e268e95e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:02.331087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b580f-518a-4a9a-b0b0-b3f8e268e95e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:02.341884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 526/1045] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:02 2022] GET /identity/v3/role_assignments?user.id=38af4d5f21ae43b699d7890ce9534d29&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=de815dab8d1d44f183230021499df564 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:02.470289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee4170-f6c9-4d2a-90a4-eeb5203fcb4f None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.470573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee4170-f6c9-4d2a-90a4-eeb5203fcb4f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.470851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee4170-f6c9-4d2a-90a4-eeb5203fcb4f None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.472210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 520/1046] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:02.479469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bc20-cafb-4788-9ba4-5647b05a22e4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.479753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bc20-cafb-4788-9ba4-5647b05a22e4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.480032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bc20-cafb-4788-9ba4-5647b05a22e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.500105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6a93bc20-cafb-4788-9ba4-5647b05a22e4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:02.501207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6a93bc20-cafb-4788-9ba4-5647b05a22e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:02.570795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 527/1047] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:02.843278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee4170-f6c9-4d2a-90a4-eeb5203fcb4f None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:02.926102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:02.949979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee4170-f6c9-4d2a-90a4-eeb5203fcb4f None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:02.984796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb66dd2-9f4a-4161-aa96-18e336eaea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:02.985434 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb66dd2-9f4a-4161-aa96-18e336eaea24 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.985707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb66dd2-9f4a-4161-aa96-18e336eaea24 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.986008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb66dd2-9f4a-4161-aa96-18e336eaea24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.996552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb66dd2-9f4a-4161-aa96-18e336eaea24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-1eb66dd2-9f4a-4161-aa96-18e336eaea24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:03.001246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:03.002426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:03.003327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:03.011188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 521/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:03.011336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93bc20-cafb-4788-9ba4-5647b05a22e4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.064712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:03.113050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93bc20-cafb-4788-9ba4-5647b05a22e4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.158405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.159391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.159936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.160382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.161277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:03.161744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.163290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.172866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 528/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:03.178232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb66dd2-9f4a-4161-aa96-18e336eaea24 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.281694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb66dd2-9f4a-4161-aa96-18e336eaea24 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.315876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52203006-c549-47f5-a169-88030da651ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.316507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203006-c549-47f5-a169-88030da651ae None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.316781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203006-c549-47f5-a169-88030da651ae None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.317052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52203006-c549-47f5-a169-88030da651ae None admin] PATH_INFO: `/v3/users/1fbedc653ba1403bb0e75190202a2f38` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.325639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:03.333052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52203006-c549-47f5-a169-88030da651ae None admin] RBAC: Authorizing `identity:get_user(user_id=1fbedc653ba1403bb0e75190202a2f38)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.334533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52203006-c549-47f5-a169-88030da651ae None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.336401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 522/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:03 2022] GET /identity/v3/users/1fbedc653ba1403bb0e75190202a2f38 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:03.342837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.449655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a7b5f-4cb1-497f-bb1a-d42435064133 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.464132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:03.486195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a03aea-2c34-4640-b07d-68352cc74d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.487052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a03aea-2c34-4640-b07d-68352cc74d17 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.487327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a03aea-2c34-4640-b07d-68352cc74d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.487595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a03aea-2c34-4640-b07d-68352cc74d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.556179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a03aea-2c34-4640-b07d-68352cc74d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.557932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a03aea-2c34-4640-b07d-68352cc74d17 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.657005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 529/1051] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 15:28:03.662584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52203006-c549-47f5-a169-88030da651ae None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.765540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52203006-c549-47f5-a169-88030da651ae None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.801010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e8a43-5f41-4d3f-9f73-9fac8e16745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.801640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8a43-5f41-4d3f-9f73-9fac8e16745a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.801940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8a43-5f41-4d3f-9f73-9fac8e16745a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.802215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8a43-5f41-4d3f-9f73-9fac8e16745a None admin] PATH_INFO: `/v3/projects/0dcf302f337c4066951f59016770ff4c` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.803309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e8a43-5f41-4d3f-9f73-9fac8e16745a None admin] RBAC: Authorizing `identity:get_project(project_id=0dcf302f337c4066951f59016770ff4c)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.804739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e8a43-5f41-4d3f-9f73-9fac8e16745a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.811702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 523/1052] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:03 2022] GET /identity/v3/projects/0dcf302f337c4066951f59016770ff4c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:03.813298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a03aea-2c34-4640-b07d-68352cc74d17 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.830168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:03.918216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387a502-4c00-4047-9a37-0bd877d38d7f None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.918748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387a502-4c00-4047-9a37-0bd877d38d7f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.918988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387a502-4c00-4047-9a37-0bd877d38d7f None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.920343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 524/1053] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:28:03.920887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a03aea-2c34-4640-b07d-68352cc74d17 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.925545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e29a08-a351-49c4-9388-fcb22eb94963 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.925829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e29a08-a351-49c4-9388-fcb22eb94963 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.926135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e29a08-a351-49c4-9388-fcb22eb94963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.944127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-46e29a08-a351-49c4-9388-fcb22eb94963 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:03.945321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-46e29a08-a351-49c4-9388-fcb22eb94963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:03.958120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2bb81-ccf6-4085-9e90-06f7f0cfc710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.958731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2bb81-ccf6-4085-9e90-06f7f0cfc710 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.959011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2bb81-ccf6-4085-9e90-06f7f0cfc710 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.959284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2bb81-ccf6-4085-9e90-06f7f0cfc710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.960013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2bb81-ccf6-4085-9e90-06f7f0cfc710 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=0dcf302f337c4066951f59016770ff4c, user.id=1fbedc653ba1403bb0e75190202a2f38) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:03.960317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2bb81-ccf6-4085-9e90-06f7f0cfc710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.961756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2bb81-ccf6-4085-9e90-06f7f0cfc710 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.974462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 530/1054] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:03 2022] GET /identity/v3/role_assignments?user.id=1fbedc653ba1403bb0e75190202a2f38&scope.project.id=0dcf302f337c4066951f59016770ff4c&role.id=cac8d7ae8325488684667d62304b0860 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:04.011922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.022127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 525/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:04.279876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e4583-4771-4720-859c-a867bfe6916b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.280430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e4583-4771-4720-859c-a867bfe6916b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.280430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e4583-4771-4720-859c-a867bfe6916b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.281888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 531/1056] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:04.286743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844edfd9-1bf2-4fc2-bbc8-6bec7d765192 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.287036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844edfd9-1bf2-4fc2-bbc8-6bec7d765192 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.287315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844edfd9-1bf2-4fc2-bbc8-6bec7d765192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.295242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e4583-4771-4720-859c-a867bfe6916b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.305516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-844edfd9-1bf2-4fc2-bbc8-6bec7d765192 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:04.307302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-844edfd9-1bf2-4fc2-bbc8-6bec7d765192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:04.381278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.390291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 526/1057] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:04.407305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e4583-4771-4720-859c-a867bfe6916b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.451568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.452382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.452666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.452940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.453521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.455988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:04.472627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:04.473694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:04.475953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 532/1058] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:04.480119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844edfd9-1bf2-4fc2-bbc8-6bec7d765192 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.587479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844edfd9-1bf2-4fc2-bbc8-6bec7d765192 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.614579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.626742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.627353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.627631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.627947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.628580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] RBAC: Adding query filter params (name=image) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:04.628880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.630280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:04.640064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 527/1059] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:04.641144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.668599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.750060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03dfed-6ca9-417d-845f-95d6d902e4a1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.772129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ee3f9-5578-480e-9a47-b6d22d445cdc None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.784128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.784735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.785015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.785284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.785937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:04.786232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.787597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:04.793314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 533/1060] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:04.798939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.808237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.812065 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be007336-a54b-4cf7-843e-74ce218ce835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.812741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be007336-a54b-4cf7-843e-74ce218ce835 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.813028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be007336-a54b-4cf7-843e-74ce218ce835 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.813298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be007336-a54b-4cf7-843e-74ce218ce835 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.825654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be007336-a54b-4cf7-843e-74ce218ce835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-be007336-a54b-4cf7-843e-74ce218ce835 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:04.830415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:04.831367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:04.834844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 528/1061] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:04.837727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be007336-a54b-4cf7-843e-74ce218ce835 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.889677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.912884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d59c0-f3ea-456c-be48-762ba3f502d6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.946026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be007336-a54b-4cf7-843e-74ce218ce835 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.955325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ed230-9ab3-48be-bfd5-58dac8d66c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.956664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ed230-9ab3-48be-bfd5-58dac8d66c97 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.957163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ed230-9ab3-48be-bfd5-58dac8d66c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.958746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ed230-9ab3-48be-bfd5-58dac8d66c97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.959433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ed230-9ab3-48be-bfd5-58dac8d66c97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.960807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ed230-9ab3-48be-bfd5-58dac8d66c97 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:04.982645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 534/1062] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:28:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:28:04.999129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.000042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.000329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.000608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.001310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:05.001622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.003106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.013098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 529/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:05.018857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ed230-9ab3-48be-bfd5-58dac8d66c97 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.090848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.139579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ed230-9ab3-48be-bfd5-58dac8d66c97 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.175120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.175750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.176027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.176292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.187782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.189230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:05.203850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:05.204837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:05.205754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:05.205754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:05.205754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:05.205754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 535/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:05.211126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.316124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6158-c9f0-4975-b120-8048ad972c2c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.324044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.353912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.354564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.354853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.355128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.355769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:05.356070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.357454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.369495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 530/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:05.374972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.480546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fbc3-b1ed-452c-a9a2-c3b3cc478950 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.495118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.517954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.518586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.518868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.519142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.527343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.528790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:28:05.540038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:05.541115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:05.547171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 536/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:05.549097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.654144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f957e2-506c-4750-97d2-07362c145c33 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.689075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.689686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.690015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.690292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.691010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:05.691316 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.692755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.711805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 531/1067] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:05.716149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.820312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f3f3-f52f-420f-8531-544e45fc6529 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.862498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e1ed9-1ec1-45fb-9b34-e975d65a2b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.863134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e1ed9-1ec1-45fb-9b34-e975d65a2b5b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.863413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e1ed9-1ec1-45fb-9b34-e975d65a2b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.863684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e1ed9-1ec1-45fb-9b34-e975d65a2b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.875228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e1ed9-1ec1-45fb-9b34-e975d65a2b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.877682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e1ed9-1ec1-45fb-9b34-e975d65a2b5b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e85e1ed9-1ec1-45fb-9b34-e975d65a2b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:05.893392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:05.894572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:05.895507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:05.895507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:05.895507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:05.895507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 537/1068] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:05.902587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.918799 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787320-9248-47e1-8e10-432e83772288 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.919083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787320-9248-47e1-8e10-432e83772288 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.919359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67787320-9248-47e1-8e10-432e83772288 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.920714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 538/1069] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:05.925806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c638d-3dfa-41e3-b9b8-40f3a7411280 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.926116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c638d-3dfa-41e3-b9b8-40f3a7411280 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.926417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c638d-3dfa-41e3-b9b8-40f3a7411280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.934032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.945461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bd9c638d-3dfa-41e3-b9b8-40f3a7411280 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:05.946089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bd9c638d-3dfa-41e3-b9b8-40f3a7411280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:05.969977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:06.020675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b598-56b1-42e5-8189-8de68f2057bd None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.026481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 539/1070] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:06.057484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.058118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.058409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.058683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.059321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:06.059624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.060995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.073335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 532/1071] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:06.078748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c638d-3dfa-41e3-b9b8-40f3a7411280 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.190598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c638d-3dfa-41e3-b9b8-40f3a7411280 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.226344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.226965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.227243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.227511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.234363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.235798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:28:06.247210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:06.248107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:06.253808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 540/1072] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:06.255897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.303991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.324687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:06.353138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:06.372725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e2c5a-8f97-4583-bc22-cef1099fd04e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.409105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.409708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.410015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.410292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.410980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:06.411285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.412719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.414376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779b900-c33c-4f22-8ff6-35aeda0b3700 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.425109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 533/1073] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:06.431569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.458928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55ed7-0519-4168-9ce0-d0213cb87b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.459798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55ed7-0519-4168-9ce0-d0213cb87b80 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.460244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55ed7-0519-4168-9ce0-d0213cb87b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.460671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55ed7-0519-4168-9ce0-d0213cb87b80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.472518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f55ed7-0519-4168-9ce0-d0213cb87b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-58f55ed7-0519-4168-9ce0-d0213cb87b80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:06.477629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:06.478935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:06.479933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:06.482251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 541/1074] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:06.487962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55ed7-0519-4168-9ce0-d0213cb87b80 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.550044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e49aad-d0d7-44fa-a052-c0d5eb4c4d8b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.570137 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:06.592005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6999-4d8d-4ee9-9bc3-6ced422aad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.592963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6999-4d8d-4ee9-9bc3-6ced422aad1c None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.593689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6999-4d8d-4ee9-9bc3-6ced422aad1c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.594005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6999-4d8d-4ee9-9bc3-6ced422aad1c None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/38af4d5f21ae43b699d7890ce9534d29/roles/de815dab8d1d44f183230021499df564` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.596249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55ed7-0519-4168-9ce0-d0213cb87b80 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.596509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d6999-4d8d-4ee9-9bc3-6ced422aad1c None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=38af4d5f21ae43b699d7890ce9534d29, role_id=de815dab8d1d44f183230021499df564)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.598275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d6999-4d8d-4ee9-9bc3-6ced422aad1c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.615404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 534/1075] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:06 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/38af4d5f21ae43b699d7890ce9534d29/roles/de815dab8d1d44f183230021499df564 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:28:06.647445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.648080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.648358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.648631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.649311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:06.649697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.651310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.662687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 542/1076] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:06.668745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6999-4d8d-4ee9-9bc3-6ced422aad1c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.672956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:06.784260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6999-4d8d-4ee9-9bc3-6ced422aad1c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.820327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247e3b0-7bb4-43ef-a4e1-36282ebb104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.820968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e3b0-7bb4-43ef-a4e1-36282ebb104f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.821251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e3b0-7bb4-43ef-a4e1-36282ebb104f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.821549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247e3b0-7bb4-43ef-a4e1-36282ebb104f None admin] PATH_INFO: `/v3/users/1fbedc653ba1403bb0e75190202a2f38` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.822720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247e3b0-7bb4-43ef-a4e1-36282ebb104f None admin] RBAC: Authorizing `identity:get_user(user_id=1fbedc653ba1403bb0e75190202a2f38)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.824170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247e3b0-7bb4-43ef-a4e1-36282ebb104f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.829011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 535/1077] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/users/1fbedc653ba1403bb0e75190202a2f38 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:06.831814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.935418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f5a89-d7c9-4bf1-bd2f-a4a78b833b12 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.970475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a0d0a-962e-4f13-a878-b17b3e7f17fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.971104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a0d0a-962e-4f13-a878-b17b3e7f17fe None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.971386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a0d0a-962e-4f13-a878-b17b3e7f17fe None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.971661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a0d0a-962e-4f13-a878-b17b3e7f17fe None admin] PATH_INFO: `/v3/projects/0dcf302f337c4066951f59016770ff4c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.972775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a0d0a-962e-4f13-a878-b17b3e7f17fe None admin] RBAC: Authorizing `identity:get_project(project_id=0dcf302f337c4066951f59016770ff4c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.974258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a0d0a-962e-4f13-a878-b17b3e7f17fe None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.976046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 543/1078] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/projects/0dcf302f337c4066951f59016770ff4c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:06.982512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247e3b0-7bb4-43ef-a4e1-36282ebb104f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:07.004816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f488-c687-4626-ba3f-769d2efa0827 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:07.005335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f488-c687-4626-ba3f-769d2efa0827 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:07.005609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f488-c687-4626-ba3f-769d2efa0827 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:07.007111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 544/1079] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:28:07.012989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef6894-ef26-472a-96a0-1fed2fd69c5f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:07.013265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef6894-ef26-472a-96a0-1fed2fd69c5f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:07.013531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef6894-ef26-472a-96a0-1fed2fd69c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:07.026557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:07.033522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f9ef6894-ef26-472a-96a0-1fed2fd69c5f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:07.034833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f9ef6894-ef26-472a-96a0-1fed2fd69c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:07.061319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:07.099104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247e3b0-7bb4-43ef-a4e1-36282ebb104f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:07.114570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 545/1080] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:07.139812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c5fbb-074f-4ed2-8bfa-b59feefdf69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:07.140467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c5fbb-074f-4ed2-8bfa-b59feefdf69c None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:07.140746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c5fbb-074f-4ed2-8bfa-b59feefdf69c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:07.141018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c5fbb-074f-4ed2-8bfa-b59feefdf69c None admin] PATH_INFO: `/v3/projects/0dcf302f337c4066951f59016770ff4c/users/1fbedc653ba1403bb0e75190202a2f38/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:07.142941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c5fbb-074f-4ed2-8bfa-b59feefdf69c None admin] RBAC: Authorizing `identity:create_grant(project_id=0dcf302f337c4066951f59016770ff4c, user_id=1fbedc653ba1403bb0e75190202a2f38, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:07.144377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c5fbb-074f-4ed2-8bfa-b59feefdf69c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:07.165867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 536/1081] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:06 2022] PUT /identity/v3/projects/0dcf302f337c4066951f59016770ff4c/users/1fbedc653ba1403bb0e75190202a2f38/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:07.380850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef6894-ef26-472a-96a0-1fed2fd69c5f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:07.483497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef6894-ef26-472a-96a0-1fed2fd69c5f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:07.520326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717d3bb-8c42-4110-948b-bc0b990f77be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:07.521287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717d3bb-8c42-4110-948b-bc0b990f77be None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:07.521772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717d3bb-8c42-4110-948b-bc0b990f77be None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:07.522287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717d3bb-8c42-4110-948b-bc0b990f77be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:07.526146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:07.594780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717d3bb-8c42-4110-948b-bc0b990f77be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:07.596264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717d3bb-8c42-4110-948b-bc0b990f77be None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:07.700295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 546/1082] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:07.706280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c5fbb-074f-4ed2-8bfa-b59feefdf69c None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:07.814054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c5fbb-074f-4ed2-8bfa-b59feefdf69c None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:07.845117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:07.851740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776f26e-91b6-4d4b-b8e5-ed236101f7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:07.852411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f26e-91b6-4d4b-b8e5-ed236101f7ef None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:07.852921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f26e-91b6-4d4b-b8e5-ed236101f7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:07.853414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776f26e-91b6-4d4b-b8e5-ed236101f7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:07.864444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776f26e-91b6-4d4b-b8e5-ed236101f7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:07.865924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776f26e-91b6-4d4b-b8e5-ed236101f7ef None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-3776f26e-91b6-4d4b-b8e5-ed236101f7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:07.880155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:07.881110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:07.887768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:07.887768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:07.887768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:07.887768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 537/1083] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:07.888024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717d3bb-8c42-4110-948b-bc0b990f77be None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:07.922229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:07.990558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717d3bb-8c42-4110-948b-bc0b990f77be None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.025775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbcef1-2086-4c09-9800-2693b49b01ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.026413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbcef1-2086-4c09-9800-2693b49b01ea None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.026691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbcef1-2086-4c09-9800-2693b49b01ea None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.026959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbcef1-2086-4c09-9800-2693b49b01ea None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.027597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbcef1-2086-4c09-9800-2693b49b01ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:08.027898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbcef1-2086-4c09-9800-2693b49b01ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:08.029548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbcef1-2086-4c09-9800-2693b49b01ea None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:08.049870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 547/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:08.596727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9295b-fd96-431c-813f-4f094af0602d None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.597277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9295b-fd96-431c-813f-4f094af0602d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.597277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9295b-fd96-431c-813f-4f094af0602d None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.598682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 538/1085] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:08.604500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3235b-5f1b-4360-84d0-378526517f13 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.604918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3235b-5f1b-4360-84d0-378526517f13 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.605057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3235b-5f1b-4360-84d0-378526517f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.623942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6cb3235b-5f1b-4360-84d0-378526517f13 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:08.625132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6cb3235b-5f1b-4360-84d0-378526517f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:08.697697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 548/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:08.974102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9295b-fd96-431c-813f-4f094af0602d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.076362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9295b-fd96-431c-813f-4f094af0602d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.078856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5014d-8383-4e9e-ad78-73efd3cfbd07 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.079150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5014d-8383-4e9e-ad78-73efd3cfbd07 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.079436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5014d-8383-4e9e-ad78-73efd3cfbd07 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.080785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 549/1087] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:28:09.085582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ad189-72b9-4a2d-a937-8e0390a649d5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.085883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ad189-72b9-4a2d-a937-8e0390a649d5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.086165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ad189-72b9-4a2d-a937-8e0390a649d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.104102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ad2ad189-72b9-4a2d-a937-8e0390a649d5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:09.105292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ad2ad189-72b9-4a2d-a937-8e0390a649d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:09.112061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bca501-b843-4d6f-8c89-1e6e7ce5ed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.112688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bca501-b843-4d6f-8c89-1e6e7ce5ed97 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.112973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bca501-b843-4d6f-8c89-1e6e7ce5ed97 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.113241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bca501-b843-4d6f-8c89-1e6e7ce5ed97 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.125144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bca501-b843-4d6f-8c89-1e6e7ce5ed97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:09.126350 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-54bca501-b843-4d6f-8c89-1e6e7ce5ed97 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:09.128513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:09.129563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:09.130466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 539/1088] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:09.135911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bca501-b843-4d6f-8c89-1e6e7ce5ed97 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.178302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 550/1089] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:09.183656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.236010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bca501-b843-4d6f-8c89-1e6e7ce5ed97 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.269744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.270365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.270643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.270936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.271588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:09.271886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.273252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.281135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 540/1090] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:09.286794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ad189-72b9-4a2d-a937-8e0390a649d5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.384919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ad189-72b9-4a2d-a937-8e0390a649d5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.418360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.418991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.419269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.419541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.429179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.431211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:09.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:09.447188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:09.448088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:09.448088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:09.448088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:09.448088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 551/1091] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:09.451838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.453351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.464632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.553001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff91329-46e1-4731-a795-e0fd5a168922 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.553287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcd041-cc42-4b5e-8e1f-a5c54f8c7699 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.560753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.587248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.588022 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.588303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.588575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.589003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daa4ec-2d7b-4aa1-9c0f-b6d3ea69f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.589210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:09.589513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.589633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa4ec-2d7b-4aa1-9c0f-b6d3ea69f641 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.589966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa4ec-2d7b-4aa1-9c0f-b6d3ea69f641 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.590247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa4ec-2d7b-4aa1-9c0f-b6d3ea69f641 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.590914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.600652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daa4ec-2d7b-4aa1-9c0f-b6d3ea69f641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:09.602751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 552/1092] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-71daa4ec-2d7b-4aa1-9c0f-b6d3ea69f641 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:09.605535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:09.606684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:09.607567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 541/1093] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:09.608711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.612499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daa4ec-2d7b-4aa1-9c0f-b6d3ea69f641 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.674885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.709024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc23a0-cb9a-49ca-b932-a058a564976e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.713417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daa4ec-2d7b-4aa1-9c0f-b6d3ea69f641 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.744400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.745068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.745357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.745631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.748689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.749293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.749575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.749871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.750541 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:09.750845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.752263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.752582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.754041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.761135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 542/1094] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:09.766773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:28:09.766948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:09.768028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:09.769198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 553/1095] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:09.773609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.797498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.870336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ea34-46e7-4b35-9218-d03761f5a881 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.872516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a39ee-9f26-4566-ab9d-0180fc0f039b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.898111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.903395 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd031f-1140-49cc-98d2-ca8ac160bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.904026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd031f-1140-49cc-98d2-ca8ac160bfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.904315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd031f-1140-49cc-98d2-ca8ac160bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.904587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd031f-1140-49cc-98d2-ca8ac160bfe9 None admin] PATH_INFO: `/v3/users/1fbedc653ba1403bb0e75190202a2f38` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.905699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd031f-1140-49cc-98d2-ca8ac160bfe9 None admin] RBAC: Authorizing `identity:get_user(user_id=1fbedc653ba1403bb0e75190202a2f38)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.906316 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.906917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.907183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd031f-1140-49cc-98d2-ca8ac160bfe9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.907278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.907452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.908168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:09.908477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.908776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 543/1096] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/users/1fbedc653ba1403bb0e75190202a2f38 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:09.909983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.914512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd031f-1140-49cc-98d2-ca8ac160bfe9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.927847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 554/1097] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:09.934092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.019207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.027140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd031f-1140-49cc-98d2-ca8ac160bfe9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.033627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bc263-216c-4182-b5a1-958dadfdf8a7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.061328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888edc4-71b4-470e-aa08-d692ffdb2daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.061959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888edc4-71b4-470e-aa08-d692ffdb2daf None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.062239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888edc4-71b4-470e-aa08-d692ffdb2daf None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.062514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888edc4-71b4-470e-aa08-d692ffdb2daf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.069188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c4201-7769-4ad8-8b65-9bcd0faee8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.069793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c4201-7769-4ad8-8b65-9bcd0faee8ac None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.070101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c4201-7769-4ad8-8b65-9bcd0faee8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.070372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c4201-7769-4ad8-8b65-9bcd0faee8ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.127192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.134299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888edc4-71b4-470e-aa08-d692ffdb2daf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.136060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888edc4-71b4-470e-aa08-d692ffdb2daf None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.145022 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c4201-7769-4ad8-8b65-9bcd0faee8ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.146527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c4201-7769-4ad8-8b65-9bcd0faee8ac None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.227751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.234623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 544/1098] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 15:28:10.240620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888edc4-71b4-470e-aa08-d692ffdb2daf None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.249712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 555/1099] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 15:28:10.255301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c4201-7769-4ad8-8b65-9bcd0faee8ac None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.342482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.345285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888edc4-71b4-470e-aa08-d692ffdb2daf None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.358321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c4201-7769-4ad8-8b65-9bcd0faee8ac None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.379898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afa8c3-bb62-4946-ae93-deeada78fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.380454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afa8c3-bb62-4946-ae93-deeada78fcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.380737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afa8c3-bb62-4946-ae93-deeada78fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.381017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afa8c3-bb62-4946-ae93-deeada78fcc3 None admin] PATH_INFO: `/v3/projects/0dcf302f337c4066951f59016770ff4c` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.382150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afa8c3-bb62-4946-ae93-deeada78fcc3 None admin] RBAC: Authorizing `identity:get_project(project_id=0dcf302f337c4066951f59016770ff4c)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.383589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afa8c3-bb62-4946-ae93-deeada78fcc3 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.385997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 545/1100] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/projects/0dcf302f337c4066951f59016770ff4c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:10.391949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afa8c3-bb62-4946-ae93-deeada78fcc3 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.393112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.393735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.394047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.394323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.404335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.405773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:10.420200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:10.421254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:10.422226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:10.422226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:10.422226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:10.422226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 556/1101] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:10.426844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.458486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.498020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afa8c3-bb62-4946-ae93-deeada78fcc3 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.532566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13052712-740e-45d0-a6e7-700b2e7b7ec7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.533970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.534582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.534864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.535136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.535860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=0dcf302f337c4066951f59016770ff4c, user.id=1fbedc653ba1403bb0e75190202a2f38) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:10.536167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.537606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.545033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 546/1102] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/role_assignments?user.id=1fbedc653ba1403bb0e75190202a2f38&scope.project.id=0dcf302f337c4066951f59016770ff4c&role.id=cac8d7ae8325488684667d62304b0860 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:10.568920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.569574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.569870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.570151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.570811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:10.571111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.572762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.580827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.586752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 557/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:10.592914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.711946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c4e1-64c3-431b-9c3d-1ff1b274bcc2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.739407 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.747929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.748559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.748834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.749102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.755746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.757183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:28:10.769045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:10.770183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:10.771110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 547/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:10.776664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.873525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb98bd-e191-4fc9-9efb-c8a42788b1d8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.907675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d120b-26b1-4698-bfa8-d9868c4630fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.908269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d120b-26b1-4698-bfa8-d9868c4630fc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.908545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d120b-26b1-4698-bfa8-d9868c4630fc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.908813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d120b-26b1-4698-bfa8-d9868c4630fc None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.909491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d120b-26b1-4698-bfa8-d9868c4630fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:10.909789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d120b-26b1-4698-bfa8-d9868c4630fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.911227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d120b-26b1-4698-bfa8-d9868c4630fc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.923087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 558/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:10.928903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:11.030838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999827f-b733-49bb-ba6d-178ebde4db64 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:11.064120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d781-fdec-405a-b27c-3945bf124992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:11.064724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d781-fdec-405a-b27c-3945bf124992 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:11.065008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d781-fdec-405a-b27c-3945bf124992 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:11.065283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d781-fdec-405a-b27c-3945bf124992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:11.066033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d781-fdec-405a-b27c-3945bf124992 None admin] RBAC: Adding query filter params (role.id=de815dab8d1d44f183230021499df564, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=38af4d5f21ae43b699d7890ce9534d29) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:11.066347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d781-fdec-405a-b27c-3945bf124992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:11.067777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d781-fdec-405a-b27c-3945bf124992 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:11.074026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 548/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/role_assignments?user.id=38af4d5f21ae43b699d7890ce9534d29&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=de815dab8d1d44f183230021499df564 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:12.499340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2a8c-50f3-40f8-bc6c-56700b59b82c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:12.499847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2a8c-50f3-40f8-bc6c-56700b59b82c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:12.499847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa2a8c-50f3-40f8-bc6c-56700b59b82c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:12.501142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 559/1107] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:12.506263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035feb4-8484-4baf-be79-b19ab1230d1d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:12.506687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035feb4-8484-4baf-be79-b19ab1230d1d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:12.506910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035feb4-8484-4baf-be79-b19ab1230d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:12.525923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-1035feb4-8484-4baf-be79-b19ab1230d1d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:12.527558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1035feb4-8484-4baf-be79-b19ab1230d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:12.577088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:12.596814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 549/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:12.870711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa2a8c-50f3-40f8-bc6c-56700b59b82c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:12.928479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:12.970379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa2a8c-50f3-40f8-bc6c-56700b59b82c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:13.003806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24c9f-aae3-4d12-8cdd-a6131d4dbc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:13.004416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24c9f-aae3-4d12-8cdd-a6131d4dbc0e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:13.004690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24c9f-aae3-4d12-8cdd-a6131d4dbc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:13.004956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24c9f-aae3-4d12-8cdd-a6131d4dbc0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:13.006067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b24c9f-aae3-4d12-8cdd-a6131d4dbc0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:13.007529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b24c9f-aae3-4d12-8cdd-a6131d4dbc0e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:13.009543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 560/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:13.016538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035feb4-8484-4baf-be79-b19ab1230d1d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:13.115094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035feb4-8484-4baf-be79-b19ab1230d1d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:13.148171 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb17b1-c1a5-46e3-8b88-5911b5bd323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:13.148777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb17b1-c1a5-46e3-8b88-5911b5bd323f None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:13.149056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb17b1-c1a5-46e3-8b88-5911b5bd323f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:13.150596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb17b1-c1a5-46e3-8b88-5911b5bd323f None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:13.151450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb17b1-c1a5-46e3-8b88-5911b5bd323f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:13.152966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb17b1-c1a5-46e3-8b88-5911b5bd323f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:13.174184 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 550/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:28:13 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:15.155517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e975d8e-d383-44b7-8dfe-639d31189638 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:15.156002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e975d8e-d383-44b7-8dfe-639d31189638 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:15.156102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e975d8e-d383-44b7-8dfe-639d31189638 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:15.157421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 561/1111] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:15.162720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94823a-86d7-4a24-8b3a-fc033b22a5e9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:15.163121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94823a-86d7-4a24-8b3a-fc033b22a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:15.163278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94823a-86d7-4a24-8b3a-fc033b22a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:15.182296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8f94823a-86d7-4a24-8b3a-fc033b22a5e9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:15.183487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8f94823a-86d7-4a24-8b3a-fc033b22a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:15.212279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:15.250195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 551/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:15.521831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e975d8e-d383-44b7-8dfe-639d31189638 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:15.622002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e975d8e-d383-44b7-8dfe-639d31189638 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:15.646057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:15.655126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14fef3-c5c9-4afa-968c-3efe0d718410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:15.655742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14fef3-c5c9-4afa-968c-3efe0d718410 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:15.656021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14fef3-c5c9-4afa-968c-3efe0d718410 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:15.656292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14fef3-c5c9-4afa-968c-3efe0d718410 None admin] PATH_INFO: `/v3/roles/2e0116277dbb4c08a7ca7e300f7faa53` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:15.657650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14fef3-c5c9-4afa-968c-3efe0d718410 None admin] RBAC: Authorizing `identity:get_role(role_id=2e0116277dbb4c08a7ca7e300f7faa53)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:15.659046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14fef3-c5c9-4afa-968c-3efe0d718410 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:15.660363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 562/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:15 2022] GET /identity/v3/roles/2e0116277dbb4c08a7ca7e300f7faa53 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:15.666760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94823a-86d7-4a24-8b3a-fc033b22a5e9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:15.764488 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94823a-86d7-4a24-8b3a-fc033b22a5e9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:15.797830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78224101-48f1-4e64-a98c-7559e93f96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:15.798412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224101-48f1-4e64-a98c-7559e93f96ac None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:15.798689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224101-48f1-4e64-a98c-7559e93f96ac None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:15.798960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224101-48f1-4e64-a98c-7559e93f96ac None admin] PATH_INFO: `/v3/users/6d4a145fc43143cdb1849f5607bd12fb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:15.811993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78224101-48f1-4e64-a98c-7559e93f96ac None admin] RBAC: Authorizing `identity:get_user(user_id=6d4a145fc43143cdb1849f5607bd12fb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:15.813440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78224101-48f1-4e64-a98c-7559e93f96ac None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:15.815033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 552/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:15 2022] GET /identity/v3/users/6d4a145fc43143cdb1849f5607bd12fb => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:15.820822 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14fef3-c5c9-4afa-968c-3efe0d718410 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:15.919326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14fef3-c5c9-4afa-968c-3efe0d718410 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:15.951910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992d9a4-5d40-4630-ba13-b37697a3ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:15.952496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992d9a4-5d40-4630-ba13-b37697a3ed7e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:15.952771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992d9a4-5d40-4630-ba13-b37697a3ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:15.953040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992d9a4-5d40-4630-ba13-b37697a3ed7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:16.011754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:16.019310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992d9a4-5d40-4630-ba13-b37697a3ed7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:16.020730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992d9a4-5d40-4630-ba13-b37697a3ed7e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:16.117379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 563/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:16.123897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78224101-48f1-4e64-a98c-7559e93f96ac None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:16.151738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:16.223716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78224101-48f1-4e64-a98c-7559e93f96ac None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:16.257231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0582e52-c8d0-44af-af8b-9d253fefa8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:16.257877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582e52-c8d0-44af-af8b-9d253fefa8db None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:16.258174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582e52-c8d0-44af-af8b-9d253fefa8db None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:16.258449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0582e52-c8d0-44af-af8b-9d253fefa8db None admin] PATH_INFO: `/v3/projects/0dcf302f337c4066951f59016770ff4c` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:16.259624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0582e52-c8d0-44af-af8b-9d253fefa8db None admin] RBAC: Authorizing `identity:get_project(project_id=0dcf302f337c4066951f59016770ff4c)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:16.261058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0582e52-c8d0-44af-af8b-9d253fefa8db None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:16.262704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 553/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:16 2022] GET /identity/v3/projects/0dcf302f337c4066951f59016770ff4c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:16.268838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992d9a4-5d40-4630-ba13-b37697a3ed7e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:16.362558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:16.369593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992d9a4-5d40-4630-ba13-b37697a3ed7e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:16.402612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be695d-85ba-4a04-8071-76a2de50a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:16.403204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be695d-85ba-4a04-8071-76a2de50a847 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:16.403482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be695d-85ba-4a04-8071-76a2de50a847 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:16.403755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be695d-85ba-4a04-8071-76a2de50a847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:16.404468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be695d-85ba-4a04-8071-76a2de50a847 None admin] RBAC: Adding query filter params (role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=0dcf302f337c4066951f59016770ff4c, user.id=6d4a145fc43143cdb1849f5607bd12fb) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:16.404773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be695d-85ba-4a04-8071-76a2de50a847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:16.406218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be695d-85ba-4a04-8071-76a2de50a847 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:16.411403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 564/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:16 2022] GET /identity/v3/role_assignments?user.id=6d4a145fc43143cdb1849f5607bd12fb&scope.project.id=0dcf302f337c4066951f59016770ff4c&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:18.303830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e071da4-5ea0-40eb-83d4-d0608f68aa85 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:18.304394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e071da4-5ea0-40eb-83d4-d0608f68aa85 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:18.304394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e071da4-5ea0-40eb-83d4-d0608f68aa85 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:18.306361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 554/1118] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:18.311499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85fc3-5f53-487f-a8b2-f1e2b1833699 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:18.311894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85fc3-5f53-487f-a8b2-f1e2b1833699 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:18.312045 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85fc3-5f53-487f-a8b2-f1e2b1833699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:18.329650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1cf85fc3-5f53-487f-a8b2-f1e2b1833699 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:18.330869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1cf85fc3-5f53-487f-a8b2-f1e2b1833699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:18.396928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 565/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:18.668795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e071da4-5ea0-40eb-83d4-d0608f68aa85 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:18.768456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:18.776985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e071da4-5ea0-40eb-83d4-d0608f68aa85 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:18.810292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3914f-6a81-4f21-a107-1a0fd1a7e777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:18.810907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3914f-6a81-4f21-a107-1a0fd1a7e777 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:18.811186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3914f-6a81-4f21-a107-1a0fd1a7e777 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:18.811458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3914f-6a81-4f21-a107-1a0fd1a7e777 None admin] PATH_INFO: `/v3/roles/2e0116277dbb4c08a7ca7e300f7faa53` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:18.812821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3914f-6a81-4f21-a107-1a0fd1a7e777 None admin] RBAC: Authorizing `identity:get_role(role_id=2e0116277dbb4c08a7ca7e300f7faa53)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:18.814215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3914f-6a81-4f21-a107-1a0fd1a7e777 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:18.815515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 555/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:18 2022] GET /identity/v3/roles/2e0116277dbb4c08a7ca7e300f7faa53 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:18.821893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf85fc3-5f53-487f-a8b2-f1e2b1833699 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:18.907348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:18.919595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf85fc3-5f53-487f-a8b2-f1e2b1833699 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:18.952527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e59e3d-185a-488b-b6e8-1f06f23f850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:18.953135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59e3d-185a-488b-b6e8-1f06f23f850d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:18.953408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59e3d-185a-488b-b6e8-1f06f23f850d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:18.953671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59e3d-185a-488b-b6e8-1f06f23f850d None admin] PATH_INFO: `/v3/users/6d4a145fc43143cdb1849f5607bd12fb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:18.954790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e59e3d-185a-488b-b6e8-1f06f23f850d None admin] RBAC: Authorizing `identity:get_user(user_id=6d4a145fc43143cdb1849f5607bd12fb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:18.956198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e59e3d-185a-488b-b6e8-1f06f23f850d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:18.957749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 566/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:18 2022] GET /identity/v3/users/6d4a145fc43143cdb1849f5607bd12fb => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:18.964301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3914f-6a81-4f21-a107-1a0fd1a7e777 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:19.061351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3914f-6a81-4f21-a107-1a0fd1a7e777 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:19.094683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7730c-a0b7-4be0-9949-0e35e2049a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:19.095302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7730c-a0b7-4be0-9949-0e35e2049a74 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:19.095582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7730c-a0b7-4be0-9949-0e35e2049a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:19.095854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7730c-a0b7-4be0-9949-0e35e2049a74 None admin] PATH_INFO: `/v3/projects/0dcf302f337c4066951f59016770ff4c` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:19.096950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7730c-a0b7-4be0-9949-0e35e2049a74 None admin] RBAC: Authorizing `identity:get_project(project_id=0dcf302f337c4066951f59016770ff4c)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:19.098415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7730c-a0b7-4be0-9949-0e35e2049a74 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:19.100022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 556/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:18 2022] GET /identity/v3/projects/0dcf302f337c4066951f59016770ff4c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:19.106546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e59e3d-185a-488b-b6e8-1f06f23f850d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:19.205096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e59e3d-185a-488b-b6e8-1f06f23f850d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:19.237822 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a161c7-2433-4dd8-aea5-ab1a0631c82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:19.238489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a161c7-2433-4dd8-aea5-ab1a0631c82e None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:19.238769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a161c7-2433-4dd8-aea5-ab1a0631c82e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:19.239040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a161c7-2433-4dd8-aea5-ab1a0631c82e None admin] PATH_INFO: `/v3/projects/0dcf302f337c4066951f59016770ff4c/users/6d4a145fc43143cdb1849f5607bd12fb/roles/2e0116277dbb4c08a7ca7e300f7faa53` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:19.241146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a161c7-2433-4dd8-aea5-ab1a0631c82e None admin] RBAC: Authorizing `identity:create_grant(project_id=0dcf302f337c4066951f59016770ff4c, user_id=6d4a145fc43143cdb1849f5607bd12fb, role_id=2e0116277dbb4c08a7ca7e300f7faa53)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:19.242607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a161c7-2433-4dd8-aea5-ab1a0631c82e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:19.255410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 567/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:19 2022] PUT /identity/v3/projects/0dcf302f337c4066951f59016770ff4c/users/6d4a145fc43143cdb1849f5607bd12fb/roles/2e0116277dbb4c08a7ca7e300f7faa53 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:21.139061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada2dd3-d4ee-449b-b1ba-ae049f585eef None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:21.139558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada2dd3-d4ee-449b-b1ba-ae049f585eef None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:21.139670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada2dd3-d4ee-449b-b1ba-ae049f585eef None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:21.140986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 557/1124] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:21.146298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef66e-9aeb-4003-8200-36cfd8d14384 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:21.146697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef66e-9aeb-4003-8200-36cfd8d14384 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:21.146848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ef66e-9aeb-4003-8200-36cfd8d14384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:21.164613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9f5ef66e-9aeb-4003-8200-36cfd8d14384 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:21.166737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f5ef66e-9aeb-4003-8200-36cfd8d14384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:21.177132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:21.233465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 568/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:21.511731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada2dd3-d4ee-449b-b1ba-ae049f585eef None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:21.541523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:21.612268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada2dd3-d4ee-449b-b1ba-ae049f585eef None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:21.646081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5ed2-2b26-4e8c-a6e6-0c28da42ad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:21.646699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5ed2-2b26-4e8c-a6e6-0c28da42ad80 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:21.646979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5ed2-2b26-4e8c-a6e6-0c28da42ad80 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:21.647253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5ed2-2b26-4e8c-a6e6-0c28da42ad80 None admin] PATH_INFO: `/v3/roles/2e0116277dbb4c08a7ca7e300f7faa53` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:21.648612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f5ed2-2b26-4e8c-a6e6-0c28da42ad80 None admin] RBAC: Authorizing `identity:get_role(role_id=2e0116277dbb4c08a7ca7e300f7faa53)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:21.650058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f5ed2-2b26-4e8c-a6e6-0c28da42ad80 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:21.651361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 558/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:21 2022] GET /identity/v3/roles/2e0116277dbb4c08a7ca7e300f7faa53 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:21.657199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef66e-9aeb-4003-8200-36cfd8d14384 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:21.755233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ef66e-9aeb-4003-8200-36cfd8d14384 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:21.790970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b66c9-9b8d-48b6-aa88-98742a07d408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:21.791520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b66c9-9b8d-48b6-aa88-98742a07d408 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:21.791804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b66c9-9b8d-48b6-aa88-98742a07d408 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:21.792079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b66c9-9b8d-48b6-aa88-98742a07d408 None admin] PATH_INFO: `/v3/users/6d4a145fc43143cdb1849f5607bd12fb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:21.793338 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b66c9-9b8d-48b6-aa88-98742a07d408 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4a145fc43143cdb1849f5607bd12fb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:21.794944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b66c9-9b8d-48b6-aa88-98742a07d408 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:21.796531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 569/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:21 2022] GET /identity/v3/users/6d4a145fc43143cdb1849f5607bd12fb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:21.802304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5ed2-2b26-4e8c-a6e6-0c28da42ad80 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:21.896325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:21.900469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5ed2-2b26-4e8c-a6e6-0c28da42ad80 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:21.934416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14917bf8-9097-4efd-86c5-07bb999331e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:21.935018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917bf8-9097-4efd-86c5-07bb999331e9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:21.935354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917bf8-9097-4efd-86c5-07bb999331e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:21.935604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917bf8-9097-4efd-86c5-07bb999331e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:22.000838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14917bf8-9097-4efd-86c5-07bb999331e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:22.002333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14917bf8-9097-4efd-86c5-07bb999331e9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:22.093909 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:22.104190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 559/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:22.105403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b66c9-9b8d-48b6-aa88-98742a07d408 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:22.121524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:22.204463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b66c9-9b8d-48b6-aa88-98742a07d408 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:22.238015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa8b39-7849-4c87-9814-0c4472f0ecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:22.238642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8b39-7849-4c87-9814-0c4472f0ecaf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:22.238920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8b39-7849-4c87-9814-0c4472f0ecaf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:22.239191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8b39-7849-4c87-9814-0c4472f0ecaf None admin] PATH_INFO: `/v3/projects/0dcf302f337c4066951f59016770ff4c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:22.240307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa8b39-7849-4c87-9814-0c4472f0ecaf None admin] RBAC: Authorizing `identity:get_project(project_id=0dcf302f337c4066951f59016770ff4c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:22.241731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa8b39-7849-4c87-9814-0c4472f0ecaf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:22.243431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 570/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:22 2022] GET /identity/v3/projects/0dcf302f337c4066951f59016770ff4c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:22.249597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14917bf8-9097-4efd-86c5-07bb999331e9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:22.346340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14917bf8-9097-4efd-86c5-07bb999331e9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:22.379464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fe41e-a9b8-471d-93a6-5db2fea7381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:22.380055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe41e-a9b8-471d-93a6-5db2fea7381e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:22.380336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe41e-a9b8-471d-93a6-5db2fea7381e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:22.380611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe41e-a9b8-471d-93a6-5db2fea7381e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:22.381332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fe41e-a9b8-471d-93a6-5db2fea7381e None admin] RBAC: Adding query filter params (role.id=2e0116277dbb4c08a7ca7e300f7faa53, scope.project.id=0dcf302f337c4066951f59016770ff4c, user.id=6d4a145fc43143cdb1849f5607bd12fb) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:22.381640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fe41e-a9b8-471d-93a6-5db2fea7381e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:22.383102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fe41e-a9b8-471d-93a6-5db2fea7381e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:22.388831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 560/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:22 2022] GET /identity/v3/role_assignments?user.id=6d4a145fc43143cdb1849f5607bd12fb&scope.project.id=0dcf302f337c4066951f59016770ff4c&role.id=2e0116277dbb4c08a7ca7e300f7faa53 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:24.526897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e8aa8-bb08-47ec-ade1-bdfc800eddaf None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:24.527435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e8aa8-bb08-47ec-ade1-bdfc800eddaf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:24.527435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e8aa8-bb08-47ec-ade1-bdfc800eddaf None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:24.528708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 571/1131] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:24.533796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c70d-1798-42db-96de-6948ed7e3bdc None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:24.534209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c70d-1798-42db-96de-6948ed7e3bdc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:24.534380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c70d-1798-42db-96de-6948ed7e3bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:24.552816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-fad8c70d-1798-42db-96de-6948ed7e3bdc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:24.554024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fad8c70d-1798-42db-96de-6948ed7e3bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:24.608757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:24.620162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 561/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:24.894820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e8aa8-bb08-47ec-ade1-bdfc800eddaf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:24.976059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:24.994934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e8aa8-bb08-47ec-ade1-bdfc800eddaf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:25.027935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8d8a-2775-448b-8281-9d6f2aa10e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:25.028544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8d8a-2775-448b-8281-9d6f2aa10e3e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:25.028819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8d8a-2775-448b-8281-9d6f2aa10e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:25.029087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8d8a-2775-448b-8281-9d6f2aa10e3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:25.030190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8d8a-2775-448b-8281-9d6f2aa10e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:25.031614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8d8a-2775-448b-8281-9d6f2aa10e3e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:25.033139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 572/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:25.038931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8c70d-1798-42db-96de-6948ed7e3bdc None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:25.135925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8c70d-1798-42db-96de-6948ed7e3bdc None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:25.169514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cbf91-3733-461e-8270-92f8711594a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:25.170077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cbf91-3733-461e-8270-92f8711594a7 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:25.170364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cbf91-3733-461e-8270-92f8711594a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:25.170640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cbf91-3733-461e-8270-92f8711594a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:25.171286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cbf91-3733-461e-8270-92f8711594a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:25.172736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cbf91-3733-461e-8270-92f8711594a7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:25.198943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 562/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:28:25 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:27.135490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0874c8-9685-407d-b145-a7305251a4d1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:27.135951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0874c8-9685-407d-b145-a7305251a4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:27.136070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0874c8-9685-407d-b145-a7305251a4d1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:27.137393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 573/1135] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:27.142579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac618b25-a220-4473-afa6-e13ce45c77f1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:27.143021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac618b25-a220-4473-afa6-e13ce45c77f1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:27.143122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac618b25-a220-4473-afa6-e13ce45c77f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:27.161298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ac618b25-a220-4473-afa6-e13ce45c77f1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:27.162511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ac618b25-a220-4473-afa6-e13ce45c77f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:27.200965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:27.227848 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 563/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:27.494973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0874c8-9685-407d-b145-a7305251a4d1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:27.593676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0874c8-9685-407d-b145-a7305251a4d1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:27.626895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f530e-4cbb-4e09-b112-cbf44fddcd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:27.627508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f530e-4cbb-4e09-b112-cbf44fddcd45 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:27.627790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f530e-4cbb-4e09-b112-cbf44fddcd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:27.628067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f530e-4cbb-4e09-b112-cbf44fddcd45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:27.629168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f530e-4cbb-4e09-b112-cbf44fddcd45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:27.630638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f530e-4cbb-4e09-b112-cbf44fddcd45 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:27.632201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 574/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:27.638594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac618b25-a220-4473-afa6-e13ce45c77f1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:27.735854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac618b25-a220-4473-afa6-e13ce45c77f1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:27.770117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab4be2-502c-40f6-b457-549831b12486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:27.770653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab4be2-502c-40f6-b457-549831b12486 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:27.770932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab4be2-502c-40f6-b457-549831b12486 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:27.771203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab4be2-502c-40f6-b457-549831b12486 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:27.771838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab4be2-502c-40f6-b457-549831b12486 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:27.773275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab4be2-502c-40f6-b457-549831b12486 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:27.794354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 564/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:28:27 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:29.747314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c529e-9d83-4ccb-bd63-401c779def2b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:29.747854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c529e-9d83-4ccb-bd63-401c779def2b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:29.747854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c529e-9d83-4ccb-bd63-401c779def2b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:29.749202 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 575/1139] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:29.754518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21050-edc0-4a17-a0e3-40e606b5994f None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:29.754922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21050-edc0-4a17-a0e3-40e606b5994f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:29.755083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21050-edc0-4a17-a0e3-40e606b5994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:29.773507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-42c21050-edc0-4a17-a0e3-40e606b5994f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:29.774799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-42c21050-edc0-4a17-a0e3-40e606b5994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:29.797371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:29.855121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 565/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:30.129899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c529e-9d83-4ccb-bd63-401c779def2b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:30.148619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:30.229527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c529e-9d83-4ccb-bd63-401c779def2b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:30.262357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2775f1d-4219-4292-ac9b-639bd87b7eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:30.262966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2775f1d-4219-4292-ac9b-639bd87b7eef None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:30.263241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2775f1d-4219-4292-ac9b-639bd87b7eef None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:30.263510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2775f1d-4219-4292-ac9b-639bd87b7eef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:30.273059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2775f1d-4219-4292-ac9b-639bd87b7eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e2775f1d-4219-4292-ac9b-639bd87b7eef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:30.278013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:30.279197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:30.280535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 576/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:30.285107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c21050-edc0-4a17-a0e3-40e606b5994f None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:30.383980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c21050-edc0-4a17-a0e3-40e606b5994f None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:30.417219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:30.417808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:30.418114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:30.418383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:30.419036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:30.419334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:30.420698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:30.428351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 566/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:30.434281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2775f1d-4219-4292-ac9b-639bd87b7eef None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:30.511355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:30.532360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2775f1d-4219-4292-ac9b-639bd87b7eef None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:30.565658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025f84f-3dca-493d-97ba-f5406ae75c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:30.566304 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f84f-3dca-493d-97ba-f5406ae75c36 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:30.566584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f84f-3dca-493d-97ba-f5406ae75c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:30.566919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f84f-3dca-493d-97ba-f5406ae75c36 None admin] PATH_INFO: `/v3/users/e0b2ba446b5e4cc0b807b6e300ff8bf6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:30.580074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025f84f-3dca-493d-97ba-f5406ae75c36 None admin] RBAC: Authorizing `identity:get_user(user_id=e0b2ba446b5e4cc0b807b6e300ff8bf6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:30.581515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025f84f-3dca-493d-97ba-f5406ae75c36 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:30.583167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 577/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:30 2022] GET /identity/v3/users/e0b2ba446b5e4cc0b807b6e300ff8bf6 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:30.589565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:30.615168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:30.688376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b2eb4-7aaa-4513-b10b-171e18835ec6 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:30.720594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0e20f-2910-44c4-95f6-0685d3cb17a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:30.721191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0e20f-2910-44c4-95f6-0685d3cb17a2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:30.721467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0e20f-2910-44c4-95f6-0685d3cb17a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:30.721734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0e20f-2910-44c4-95f6-0685d3cb17a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:30.789158 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0e20f-2910-44c4-95f6-0685d3cb17a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:30.791035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0e20f-2910-44c4-95f6-0685d3cb17a2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:30.814353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:30.889115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 567/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:30.895103 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025f84f-3dca-493d-97ba-f5406ae75c36 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:30.999576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025f84f-3dca-493d-97ba-f5406ae75c36 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:31.032011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f54b2-60e3-4500-9ad7-a97d9ebf74f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:31.032633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f54b2-60e3-4500-9ad7-a97d9ebf74f7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:31.032914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f54b2-60e3-4500-9ad7-a97d9ebf74f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:31.033188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f54b2-60e3-4500-9ad7-a97d9ebf74f7 None admin] PATH_INFO: `/v3/projects/0ade6f8532e142009ec74aeddcccb813` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:31.034321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f54b2-60e3-4500-9ad7-a97d9ebf74f7 None admin] RBAC: Authorizing `identity:get_project(project_id=0ade6f8532e142009ec74aeddcccb813)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:31.035750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f54b2-60e3-4500-9ad7-a97d9ebf74f7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:31.037362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 578/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:30 2022] GET /identity/v3/projects/0ade6f8532e142009ec74aeddcccb813 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:31.044448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0e20f-2910-44c4-95f6-0685d3cb17a2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:31.142065 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0e20f-2910-44c4-95f6-0685d3cb17a2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:31.165908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:31.177550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0271377-508f-43a5-8c20-d55267258c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:31.178184 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271377-508f-43a5-8c20-d55267258c00 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:31.178469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271377-508f-43a5-8c20-d55267258c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:31.178744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0271377-508f-43a5-8c20-d55267258c00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:31.179460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0271377-508f-43a5-8c20-d55267258c00 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=0ade6f8532e142009ec74aeddcccb813, user.id=e0b2ba446b5e4cc0b807b6e300ff8bf6) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:31.179769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0271377-508f-43a5-8c20-d55267258c00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:31.181414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0271377-508f-43a5-8c20-d55267258c00 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:31.186667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 568/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:31 2022] GET /identity/v3/role_assignments?user.id=e0b2ba446b5e4cc0b807b6e300ff8bf6&scope.project.id=0ade6f8532e142009ec74aeddcccb813&role.id=cac8d7ae8325488684667d62304b0860 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:33.081812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1241-2947-44c1-a26a-467eab2d8557 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:33.082370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1241-2947-44c1-a26a-467eab2d8557 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:33.082484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e1241-2947-44c1-a26a-467eab2d8557 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:33.083751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 579/1147] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:33.089374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6c039-8ffc-474d-8b19-0e6ae74b5247 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:33.089824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6c039-8ffc-474d-8b19-0e6ae74b5247 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:33.089962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6c039-8ffc-474d-8b19-0e6ae74b5247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:33.108049 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-cea6c039-8ffc-474d-8b19-0e6ae74b5247 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:33.109219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-cea6c039-8ffc-474d-8b19-0e6ae74b5247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:33.175860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 569/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:33.454308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1241-2947-44c1-a26a-467eab2d8557 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:33.458316 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:33.564932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e1241-2947-44c1-a26a-467eab2d8557 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:33.598858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e589a8a-3c3c-4ea8-a639-adb4107bb7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:33.599472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e589a8a-3c3c-4ea8-a639-adb4107bb7fa None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:33.599751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e589a8a-3c3c-4ea8-a639-adb4107bb7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:33.600023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e589a8a-3c3c-4ea8-a639-adb4107bb7fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:33.609963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e589a8a-3c3c-4ea8-a639-adb4107bb7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8e589a8a-3c3c-4ea8-a639-adb4107bb7fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:33.614841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:33.615955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:33.616820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 580/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:33.622588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6c039-8ffc-474d-8b19-0e6ae74b5247 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:33.718592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6c039-8ffc-474d-8b19-0e6ae74b5247 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:33.734655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:33.753521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:33.754143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:33.754424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:33.754693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:33.755354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:33.755655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:33.757031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:33.765476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 570/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:33.771427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e589a8a-3c3c-4ea8-a639-adb4107bb7fa None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:33.832942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:33.871183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e589a8a-3c3c-4ea8-a639-adb4107bb7fa None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:33.903466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e266bf7-3761-4d2e-9cef-b691a4eb4348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:33.904076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e266bf7-3761-4d2e-9cef-b691a4eb4348 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:33.904358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e266bf7-3761-4d2e-9cef-b691a4eb4348 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:33.904630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e266bf7-3761-4d2e-9cef-b691a4eb4348 None admin] PATH_INFO: `/v3/users/e0b2ba446b5e4cc0b807b6e300ff8bf6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:33.905734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e266bf7-3761-4d2e-9cef-b691a4eb4348 None admin] RBAC: Authorizing `identity:get_user(user_id=e0b2ba446b5e4cc0b807b6e300ff8bf6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:33.907193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e266bf7-3761-4d2e-9cef-b691a4eb4348 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:33.908885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 581/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:33 2022] GET /identity/v3/users/e0b2ba446b5e4cc0b807b6e300ff8bf6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:33.915380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:34.013500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe58e-1a22-4c68-af6f-3b86ce7717a1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:34.046026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450f13-935d-46b4-9335-3fcd38c4a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:34.046641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450f13-935d-46b4-9335-3fcd38c4a172 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:34.046921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450f13-935d-46b4-9335-3fcd38c4a172 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:34.047192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450f13-935d-46b4-9335-3fcd38c4a172 None admin] PATH_INFO: `/v3/projects/0ade6f8532e142009ec74aeddcccb813` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:34.048313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450f13-935d-46b4-9335-3fcd38c4a172 None admin] RBAC: Authorizing `identity:get_project(project_id=0ade6f8532e142009ec74aeddcccb813)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:34.049718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450f13-935d-46b4-9335-3fcd38c4a172 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:34.051343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 571/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:33 2022] GET /identity/v3/projects/0ade6f8532e142009ec74aeddcccb813 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:34.057912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e266bf7-3761-4d2e-9cef-b691a4eb4348 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:34.159390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e266bf7-3761-4d2e-9cef-b691a4eb4348 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:34.193647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:34.199804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b2f14-9fdb-471e-a155-fd40051cae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:34.200457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2f14-9fdb-471e-a155-fd40051cae9e None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:34.200739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2f14-9fdb-471e-a155-fd40051cae9e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:34.201013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b2f14-9fdb-471e-a155-fd40051cae9e None admin] PATH_INFO: `/v3/projects/0ade6f8532e142009ec74aeddcccb813/users/e0b2ba446b5e4cc0b807b6e300ff8bf6/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:34.202912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b2f14-9fdb-471e-a155-fd40051cae9e None admin] RBAC: Authorizing `identity:create_grant(project_id=0ade6f8532e142009ec74aeddcccb813, user_id=e0b2ba446b5e4cc0b807b6e300ff8bf6, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:34.204345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b2f14-9fdb-471e-a155-fd40051cae9e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:34.217068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 582/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:34 2022] PUT /identity/v3/projects/0ade6f8532e142009ec74aeddcccb813/users/e0b2ba446b5e4cc0b807b6e300ff8bf6/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:36.111998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a155d6-2278-4bb2-9a65-ea566a55cde9 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:36.112535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a155d6-2278-4bb2-9a65-ea566a55cde9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:36.112535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a155d6-2278-4bb2-9a65-ea566a55cde9 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:36.113891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 572/1154] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:36.119784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75d7b-8a8b-417c-b338-cb5953070f64 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:36.120219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75d7b-8a8b-417c-b338-cb5953070f64 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:36.120336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75d7b-8a8b-417c-b338-cb5953070f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:36.138530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ebd75d7b-8a8b-417c-b338-cb5953070f64 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:36.139752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ebd75d7b-8a8b-417c-b338-cb5953070f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:36.205462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 583/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:36.473518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a155d6-2278-4bb2-9a65-ea566a55cde9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:36.522425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:36.578853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a155d6-2278-4bb2-9a65-ea566a55cde9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:36.630045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729dfab-c882-4668-956b-d3c83a8d19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:36.631096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729dfab-c882-4668-956b-d3c83a8d19bd None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:36.631601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729dfab-c882-4668-956b-d3c83a8d19bd None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:36.632069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729dfab-c882-4668-956b-d3c83a8d19bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:36.643293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729dfab-c882-4668-956b-d3c83a8d19bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-4729dfab-c882-4668-956b-d3c83a8d19bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:36.651821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:36.653157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:36.655088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 573/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:36.666845 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd75d7b-8a8b-417c-b338-cb5953070f64 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:36.777759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd75d7b-8a8b-417c-b338-cb5953070f64 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:36.799473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:36.811580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:36.812181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:36.812474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:36.812726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:36.813383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:36.813683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:36.815075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:36.823501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 584/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:36.829494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729dfab-c882-4668-956b-d3c83a8d19bd None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:36.933705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729dfab-c882-4668-956b-d3c83a8d19bd None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:36.940799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:36.968632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234efa50-bac5-409b-9ff3-ae4c0ab7b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:36.969259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234efa50-bac5-409b-9ff3-ae4c0ab7b06e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:36.969543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234efa50-bac5-409b-9ff3-ae4c0ab7b06e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:36.969817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234efa50-bac5-409b-9ff3-ae4c0ab7b06e None admin] PATH_INFO: `/v3/users/e0b2ba446b5e4cc0b807b6e300ff8bf6` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:36.970956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234efa50-bac5-409b-9ff3-ae4c0ab7b06e None admin] RBAC: Authorizing `identity:get_user(user_id=e0b2ba446b5e4cc0b807b6e300ff8bf6)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:36.972403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234efa50-bac5-409b-9ff3-ae4c0ab7b06e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:36.974017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 574/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:36 2022] GET /identity/v3/users/e0b2ba446b5e4cc0b807b6e300ff8bf6 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:36.980339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:37.089001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f19cf7-2f3d-4200-ae0b-84ad3edde46e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:37.121257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff4b3b-ecef-4623-b640-0f22654fe15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:37.121884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4b3b-ecef-4623-b640-0f22654fe15f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:37.122135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4b3b-ecef-4623-b640-0f22654fe15f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:37.122404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4b3b-ecef-4623-b640-0f22654fe15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:37.175999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:37.193466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff4b3b-ecef-4623-b640-0f22654fe15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:37.194944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff4b3b-ecef-4623-b640-0f22654fe15f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:37.298736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 585/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:37.304691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234efa50-bac5-409b-9ff3-ae4c0ab7b06e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:37.403986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234efa50-bac5-409b-9ff3-ae4c0ab7b06e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:37.436798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9f1cc-ae99-423e-a4d8-62779a9ae53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:37.437406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9f1cc-ae99-423e-a4d8-62779a9ae53a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:37.437681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9f1cc-ae99-423e-a4d8-62779a9ae53a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:37.437976 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9f1cc-ae99-423e-a4d8-62779a9ae53a None admin] PATH_INFO: `/v3/projects/0ade6f8532e142009ec74aeddcccb813` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:37.439059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9f1cc-ae99-423e-a4d8-62779a9ae53a None admin] RBAC: Authorizing `identity:get_project(project_id=0ade6f8532e142009ec74aeddcccb813)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:37.440483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9f1cc-ae99-423e-a4d8-62779a9ae53a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:37.442105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 575/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:37 2022] GET /identity/v3/projects/0ade6f8532e142009ec74aeddcccb813 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:37.449039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff4b3b-ecef-4623-b640-0f22654fe15f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:37.530260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:37.547224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff4b3b-ecef-4623-b640-0f22654fe15f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:37.581848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73bd0d-cddc-4f60-a064-27a7155870cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:37.582454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bd0d-cddc-4f60-a064-27a7155870cd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:37.582734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bd0d-cddc-4f60-a064-27a7155870cd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:37.583004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73bd0d-cddc-4f60-a064-27a7155870cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:37.583720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73bd0d-cddc-4f60-a064-27a7155870cd None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=0ade6f8532e142009ec74aeddcccb813, user.id=e0b2ba446b5e4cc0b807b6e300ff8bf6) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:37.584025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73bd0d-cddc-4f60-a064-27a7155870cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:37.585449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73bd0d-cddc-4f60-a064-27a7155870cd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:37.591373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 586/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:37 2022] GET /identity/v3/role_assignments?user.id=e0b2ba446b5e4cc0b807b6e300ff8bf6&scope.project.id=0ade6f8532e142009ec74aeddcccb813&role.id=cac8d7ae8325488684667d62304b0860 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:39.531136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bb5d4-6a39-4492-acf6-2b6da9eb301b None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:39.531667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bb5d4-6a39-4492-acf6-2b6da9eb301b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:39.531667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bb5d4-6a39-4492-acf6-2b6da9eb301b None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:39.532937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 576/1162] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:39.538079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29b33d-8192-4c5a-a4b0-0d0deba12e11 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:39.538462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29b33d-8192-4c5a-a4b0-0d0deba12e11 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:39.538631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29b33d-8192-4c5a-a4b0-0d0deba12e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:39.557146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ab29b33d-8192-4c5a-a4b0-0d0deba12e11 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:39.558362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ab29b33d-8192-4c5a-a4b0-0d0deba12e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:39.624168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 587/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:39.893585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bb5d4-6a39-4492-acf6-2b6da9eb301b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:39.938641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:39.995204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bb5d4-6a39-4492-acf6-2b6da9eb301b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:40.027229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db255138-e33b-448e-9a01-6026cf7b6f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:40.027817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db255138-e33b-448e-9a01-6026cf7b6f32 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:40.028093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db255138-e33b-448e-9a01-6026cf7b6f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:40.028361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db255138-e33b-448e-9a01-6026cf7b6f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:40.092959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db255138-e33b-448e-9a01-6026cf7b6f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:40.094439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db255138-e33b-448e-9a01-6026cf7b6f32 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:40.136542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:40.192635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 577/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:40.198483 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29b33d-8192-4c5a-a4b0-0d0deba12e11 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:40.274747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:40.296681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29b33d-8192-4c5a-a4b0-0d0deba12e11 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:40.329038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787f3f9-efcb-4f48-86f4-4a77e5ebbf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:40.329654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f3f9-efcb-4f48-86f4-4a77e5ebbf04 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:40.329965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f3f9-efcb-4f48-86f4-4a77e5ebbf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:40.330242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f3f9-efcb-4f48-86f4-4a77e5ebbf04 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:40.337155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787f3f9-efcb-4f48-86f4-4a77e5ebbf04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:40.338622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787f3f9-efcb-4f48-86f4-4a77e5ebbf04 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e787f3f9-efcb-4f48-86f4-4a77e5ebbf04 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:40.353698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:40.354872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:40.355840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 588/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:28:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:40.360799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db255138-e33b-448e-9a01-6026cf7b6f32 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:40.457340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db255138-e33b-448e-9a01-6026cf7b6f32 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:40.491680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68724ff-96cb-42b1-baae-33c1cbe7a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:40.492339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68724ff-96cb-42b1-baae-33c1cbe7a67b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:40.492736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68724ff-96cb-42b1-baae-33c1cbe7a67b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:40.493031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68724ff-96cb-42b1-baae-33c1cbe7a67b None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:40.493671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68724ff-96cb-42b1-baae-33c1cbe7a67b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:40.494004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68724ff-96cb-42b1-baae-33c1cbe7a67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:40.495379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68724ff-96cb-42b1-baae-33c1cbe7a67b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:40.502261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 578/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 26 15:28:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:42.400307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594516c-0b49-4947-b0b3-a9232afb41bc None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:42.400814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594516c-0b49-4947-b0b3-a9232afb41bc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:42.400814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594516c-0b49-4947-b0b3-a9232afb41bc None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:42.402143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 589/1167] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:42.407280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944627a9-3e5e-4c12-bcb7-91cc3cb560c9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:42.407682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944627a9-3e5e-4c12-bcb7-91cc3cb560c9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:42.407840 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944627a9-3e5e-4c12-bcb7-91cc3cb560c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:42.420858 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:42.426293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-944627a9-3e5e-4c12-bcb7-91cc3cb560c9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:42.427490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-944627a9-3e5e-4c12-bcb7-91cc3cb560c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:42.494317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 579/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:42.763505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594516c-0b49-4947-b0b3-a9232afb41bc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:42.862368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594516c-0b49-4947-b0b3-a9232afb41bc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:42.894959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed89cd-8217-431b-a117-e502e411194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:42.895545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed89cd-8217-431b-a117-e502e411194b None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:42.895825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed89cd-8217-431b-a117-e502e411194b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:42.896100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed89cd-8217-431b-a117-e502e411194b None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:42.896747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed89cd-8217-431b-a117-e502e411194b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:42.898139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed89cd-8217-431b-a117-e502e411194b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:42.907413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:42.915710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 590/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Fri Aug 26 15:28:42 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:44.855216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51bfc8-8772-48ea-877b-4f3363aa77aa None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:44.855810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51bfc8-8772-48ea-877b-4f3363aa77aa None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:44.855810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51bfc8-8772-48ea-877b-4f3363aa77aa None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:44.857096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 580/1170] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:44.862614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af645c5b-28a8-4056-88ad-bf1331ce73a6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:44.863047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af645c5b-28a8-4056-88ad-bf1331ce73a6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:44.863170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af645c5b-28a8-4056-88ad-bf1331ce73a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:44.881600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-af645c5b-28a8-4056-88ad-bf1331ce73a6 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:44.882813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-af645c5b-28a8-4056-88ad-bf1331ce73a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:44.949134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 591/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:45.221418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51bfc8-8772-48ea-877b-4f3363aa77aa None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:45.325058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51bfc8-8772-48ea-877b-4f3363aa77aa None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:45.358083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b35346-499a-4705-ab6f-973a608619bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:45.358702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b35346-499a-4705-ab6f-973a608619bd None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:45.358980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b35346-499a-4705-ab6f-973a608619bd None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:45.359252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b35346-499a-4705-ab6f-973a608619bd None admin] PATH_INFO: `/v3/domains/d5450b18148d4639bfd93361dacc7b7a` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:45.362121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:45.371034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b35346-499a-4705-ab6f-973a608619bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=d5450b18148d4639bfd93361dacc7b7a)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:45.372476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b35346-499a-4705-ab6f-973a608619bd None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:45.374097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 581/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Aug 26 15:28:45 2022] GET /identity/v3/domains/d5450b18148d4639bfd93361dacc7b7a => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:45.379972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af645c5b-28a8-4056-88ad-bf1331ce73a6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:45.476640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af645c5b-28a8-4056-88ad-bf1331ce73a6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:45.502560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:45.511018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64f0bd-0c4a-40b2-8c3b-74a4cdc58e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:45.511620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64f0bd-0c4a-40b2-8c3b-74a4cdc58e7a None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:45.511900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64f0bd-0c4a-40b2-8c3b-74a4cdc58e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:45.512171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64f0bd-0c4a-40b2-8c3b-74a4cdc58e7a None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:45.512819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64f0bd-0c4a-40b2-8c3b-74a4cdc58e7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:45.514280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64f0bd-0c4a-40b2-8c3b-74a4cdc58e7a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:45.543232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 592/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:28:45 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:28:47.482934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad6b76-b387-4e3d-978b-1f41a690b1cf None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:47.483456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad6b76-b387-4e3d-978b-1f41a690b1cf None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:47.483456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad6b76-b387-4e3d-978b-1f41a690b1cf None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:47.484760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 582/1174] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:47.490374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14d90b-f7c4-4404-ac88-bdf7387beef3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:47.490781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14d90b-f7c4-4404-ac88-bdf7387beef3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:47.490914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14d90b-f7c4-4404-ac88-bdf7387beef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:47.508909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ee14d90b-f7c4-4404-ac88-bdf7387beef3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:47.511079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee14d90b-f7c4-4404-ac88-bdf7387beef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:47.577013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 593/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:47.851283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad6b76-b387-4e3d-978b-1f41a690b1cf None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:47.952642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad6b76-b387-4e3d-978b-1f41a690b1cf None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:47.985861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb40c8-ae14-4ce3-bc04-0007198cdbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:47.986743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb40c8-ae14-4ce3-bc04-0007198cdbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:47.987026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb40c8-ae14-4ce3-bc04-0007198cdbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:47.987292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb40c8-ae14-4ce3-bc04-0007198cdbe8 None admin] PATH_INFO: `/v3/domains/d5450b18148d4639bfd93361dacc7b7a` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:47.988384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb40c8-ae14-4ce3-bc04-0007198cdbe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d5450b18148d4639bfd93361dacc7b7a)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:47.989808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb40c8-ae14-4ce3-bc04-0007198cdbe8 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:47.991370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 583/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Aug 26 15:28:47 2022] GET /identity/v3/domains/d5450b18148d4639bfd93361dacc7b7a => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:47.997767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14d90b-f7c4-4404-ac88-bdf7387beef3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:48.093362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14d90b-f7c4-4404-ac88-bdf7387beef3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:48.105089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:48.129354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c5ac-e1a8-4e67-b8f7-a7954c7afb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:48.129993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c5ac-e1a8-4e67-b8f7-a7954c7afb4d None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:48.130271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c5ac-e1a8-4e67-b8f7-a7954c7afb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:48.130544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c5ac-e1a8-4e67-b8f7-a7954c7afb4d None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:48.131179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c5ac-e1a8-4e67-b8f7-a7954c7afb4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:48.132613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c5ac-e1a8-4e67-b8f7-a7954c7afb4d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:48.153022 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 594/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:28:47 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:50.105945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d6116-7d3a-4760-90d4-22b3868a2c6f None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:50.106508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d6116-7d3a-4760-90d4-22b3868a2c6f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:50.106508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d6116-7d3a-4760-90d4-22b3868a2c6f None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:50.107834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 584/1178] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:50.113191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287bc22-2537-40a2-bb5c-a76f8b616160 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:50.113625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287bc22-2537-40a2-bb5c-a76f8b616160 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:50.113734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287bc22-2537-40a2-bb5c-a76f8b616160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:50.132048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a287bc22-2537-40a2-bb5c-a76f8b616160 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:50.133244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a287bc22-2537-40a2-bb5c-a76f8b616160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:50.198559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 595/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:50.467689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d6116-7d3a-4760-90d4-22b3868a2c6f None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:50.530871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:50.568155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d6116-7d3a-4760-90d4-22b3868a2c6f None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:50.602271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64fc2a-ffa1-44bd-ae4e-9c50d6eee0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:50.603096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64fc2a-ffa1-44bd-ae4e-9c50d6eee0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:50.603448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64fc2a-ffa1-44bd-ae4e-9c50d6eee0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:50.603714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64fc2a-ffa1-44bd-ae4e-9c50d6eee0b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:50.614053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64fc2a-ffa1-44bd-ae4e-9c50d6eee0b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-cd64fc2a-ffa1-44bd-ae4e-9c50d6eee0b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:50.619426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:50.620647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:50.621799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 585/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:50.626595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287bc22-2537-40a2-bb5c-a76f8b616160 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:50.716946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:50.723830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287bc22-2537-40a2-bb5c-a76f8b616160 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:50.758482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:50.760181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:50.760464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:50.760735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:50.761390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:50.761687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:50.763077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:50.770771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 596/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:50.776716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64fc2a-ffa1-44bd-ae4e-9c50d6eee0b2 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:50.875358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64fc2a-ffa1-44bd-ae4e-9c50d6eee0b2 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:50.898779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:50.909755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9ec4c-ed82-4b84-bdc1-1c4bd755d5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:50.910402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9ec4c-ed82-4b84-bdc1-1c4bd755d5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:50.910686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9ec4c-ed82-4b84-bdc1-1c4bd755d5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:50.910962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9ec4c-ed82-4b84-bdc1-1c4bd755d5c9 None admin] PATH_INFO: `/v3/users/bed92113d72b469cbeecbdbd6940bede` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:50.928533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9ec4c-ed82-4b84-bdc1-1c4bd755d5c9 None admin] RBAC: Authorizing `identity:get_user(user_id=bed92113d72b469cbeecbdbd6940bede)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:50.930041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9ec4c-ed82-4b84-bdc1-1c4bd755d5c9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:50.932225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 586/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:50 2022] GET /identity/v3/users/bed92113d72b469cbeecbdbd6940bede => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:50.939515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:51.043052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6538514-7682-4ebb-a403-a068705e466f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:51.075437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641cdd6-eae4-426c-9472-6f6ca4b16e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:51.076141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641cdd6-eae4-426c-9472-6f6ca4b16e30 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:51.076318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641cdd6-eae4-426c-9472-6f6ca4b16e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:51.076568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641cdd6-eae4-426c-9472-6f6ca4b16e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:51.101985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:51.143399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641cdd6-eae4-426c-9472-6f6ca4b16e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:51.144841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641cdd6-eae4-426c-9472-6f6ca4b16e30 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:51.240343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 597/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:51.246837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9ec4c-ed82-4b84-bdc1-1c4bd755d5c9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:51.343821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9ec4c-ed82-4b84-bdc1-1c4bd755d5c9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:51.377896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ccec7-d52d-4467-b1ab-27a48013f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:51.378516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ccec7-d52d-4467-b1ab-27a48013f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:51.378797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ccec7-d52d-4467-b1ab-27a48013f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:51.379071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ccec7-d52d-4467-b1ab-27a48013f9a2 None admin] PATH_INFO: `/v3/projects/d3437032f7354e89974d0fb78220dbbe` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:51.380164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ccec7-d52d-4467-b1ab-27a48013f9a2 None admin] RBAC: Authorizing `identity:get_project(project_id=d3437032f7354e89974d0fb78220dbbe)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:51.381598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ccec7-d52d-4467-b1ab-27a48013f9a2 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:51.383272 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 587/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:51 2022] GET /identity/v3/projects/d3437032f7354e89974d0fb78220dbbe => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:51.389673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641cdd6-eae4-426c-9472-6f6ca4b16e30 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:51.445475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:51.486772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641cdd6-eae4-426c-9472-6f6ca4b16e30 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:51.518936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a3c7-5a43-4653-8a88-a7f3093f81b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:51.519529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a3c7-5a43-4653-8a88-a7f3093f81b6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:51.519809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a3c7-5a43-4653-8a88-a7f3093f81b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:51.520082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a3c7-5a43-4653-8a88-a7f3093f81b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:51.520798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a3c7-5a43-4653-8a88-a7f3093f81b6 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=d3437032f7354e89974d0fb78220dbbe, user.id=bed92113d72b469cbeecbdbd6940bede) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:51.521105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a3c7-5a43-4653-8a88-a7f3093f81b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:51.522568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a3c7-5a43-4653-8a88-a7f3093f81b6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:51.528330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 598/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:51 2022] GET /identity/v3/role_assignments?user.id=bed92113d72b469cbeecbdbd6940bede&scope.project.id=d3437032f7354e89974d0fb78220dbbe&role.id=cac8d7ae8325488684667d62304b0860 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:53.424947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab936-eedd-4b5d-9fc5-d90170d407f2 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:53.425455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab936-eedd-4b5d-9fc5-d90170d407f2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:53.425455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdab936-eedd-4b5d-9fc5-d90170d407f2 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:53.426916 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 588/1186] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:53.432735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ebb4-dd49-49d4-8eaf-6182d331352a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:53.433152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ebb4-dd49-49d4-8eaf-6182d331352a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:53.433283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ebb4-dd49-49d4-8eaf-6182d331352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:53.451492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4201ebb4-dd49-49d4-8eaf-6182d331352a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:53.452671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4201ebb4-dd49-49d4-8eaf-6182d331352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:53.517236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 599/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:53.789813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdab936-eedd-4b5d-9fc5-d90170d407f2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:53.840498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:53.890534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdab936-eedd-4b5d-9fc5-d90170d407f2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:53.922795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e6ba-9e55-4558-a868-5fe05113fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:53.923415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e6ba-9e55-4558-a868-5fe05113fba7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:53.923694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e6ba-9e55-4558-a868-5fe05113fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:53.923963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651e6ba-9e55-4558-a868-5fe05113fba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:53.934552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651e6ba-9e55-4558-a868-5fe05113fba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b651e6ba-9e55-4558-a868-5fe05113fba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:53.939156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:53.940180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:28:53.941501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 589/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:53.946246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ebb4-dd49-49d4-8eaf-6182d331352a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:53.997492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:54.042821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ebb4-dd49-49d4-8eaf-6182d331352a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:54.075210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:54.075799 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:54.076085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:54.076355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:54.077007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:54.077307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:54.078697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:54.086415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 600/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:54.092262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e6ba-9e55-4558-a868-5fe05113fba7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:54.191347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651e6ba-9e55-4558-a868-5fe05113fba7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:54.201797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:54.224598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8155-e9a7-429a-a50d-f3d92abdf84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:54.225213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8155-e9a7-429a-a50d-f3d92abdf84b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:54.225489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8155-e9a7-429a-a50d-f3d92abdf84b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:54.225758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c8155-e9a7-429a-a50d-f3d92abdf84b None admin] PATH_INFO: `/v3/users/bed92113d72b469cbeecbdbd6940bede` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:54.226882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c8155-e9a7-429a-a50d-f3d92abdf84b None admin] RBAC: Authorizing `identity:get_user(user_id=bed92113d72b469cbeecbdbd6940bede)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:54.229198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c8155-e9a7-429a-a50d-f3d92abdf84b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:54.230796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 590/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:54 2022] GET /identity/v3/users/bed92113d72b469cbeecbdbd6940bede => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:54.236896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:54.333952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e983f5-57af-44d0-a4f8-fca4aebd680b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:54.347073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:54.367489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234979-29ab-4888-9168-dd5edbb092d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:54.368090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234979-29ab-4888-9168-dd5edbb092d2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:54.368959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234979-29ab-4888-9168-dd5edbb092d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:54.369461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234979-29ab-4888-9168-dd5edbb092d2 None admin] PATH_INFO: `/v3/projects/d3437032f7354e89974d0fb78220dbbe` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:54.370591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234979-29ab-4888-9168-dd5edbb092d2 None admin] RBAC: Authorizing `identity:get_project(project_id=d3437032f7354e89974d0fb78220dbbe)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:54.372007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234979-29ab-4888-9168-dd5edbb092d2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:54.373592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 601/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:54 2022] GET /identity/v3/projects/d3437032f7354e89974d0fb78220dbbe => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:54.379504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8155-e9a7-429a-a50d-f3d92abdf84b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:54.477019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c8155-e9a7-429a-a50d-f3d92abdf84b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:54.511351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd9f2b-686e-438a-9136-34b890fe2c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:54.512018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9f2b-686e-438a-9136-34b890fe2c41 None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:54.512296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9f2b-686e-438a-9136-34b890fe2c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:54.512566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9f2b-686e-438a-9136-34b890fe2c41 None admin] PATH_INFO: `/v3/projects/d3437032f7354e89974d0fb78220dbbe/users/bed92113d72b469cbeecbdbd6940bede/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:54.514443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9f2b-686e-438a-9136-34b890fe2c41 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3437032f7354e89974d0fb78220dbbe, user_id=bed92113d72b469cbeecbdbd6940bede, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:54.515868 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9f2b-686e-438a-9136-34b890fe2c41 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:54.528484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 591/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:54 2022] PUT /identity/v3/projects/d3437032f7354e89974d0fb78220dbbe/users/bed92113d72b469cbeecbdbd6940bede/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:56.422936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be144e-1629-479f-8ebd-bb552a7e3695 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:56.423440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be144e-1629-479f-8ebd-bb552a7e3695 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:56.423440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be144e-1629-479f-8ebd-bb552a7e3695 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:56.424734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 602/1193] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:56.430036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1840ec-e460-438a-876f-56d0fcd3a300 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:56.430460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1840ec-e460-438a-876f-56d0fcd3a300 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:56.430590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1840ec-e460-438a-876f-56d0fcd3a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:56.448820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ed1840ec-e460-438a-876f-56d0fcd3a300 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:56.450028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ed1840ec-e460-438a-876f-56d0fcd3a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:56.479114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:56.516429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 592/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:56.790034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be144e-1629-479f-8ebd-bb552a7e3695 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:56.888684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be144e-1629-479f-8ebd-bb552a7e3695 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:56.920418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5712f-65f3-4bd2-985f-1fdb04715f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:56.921027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5712f-65f3-4bd2-985f-1fdb04715f5a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:56.921305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5712f-65f3-4bd2-985f-1fdb04715f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:56.921573 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5712f-65f3-4bd2-985f-1fdb04715f5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:56.932372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5712f-65f3-4bd2-985f-1fdb04715f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e9b5712f-65f3-4bd2-985f-1fdb04715f5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:56.936979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:56.938121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:28:56.939082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 603/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:56.943990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1840ec-e460-438a-876f-56d0fcd3a300 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:57.052718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1840ec-e460-438a-876f-56d0fcd3a300 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:57.085570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:57.086199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:57.086482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:57.086759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:57.087825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:57.088128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:57.090035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:57.099319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 593/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:57.106076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5712f-65f3-4bd2-985f-1fdb04715f5a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:57.149042 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:57.205166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5712f-65f3-4bd2-985f-1fdb04715f5a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:57.237997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f095ca-f809-487e-9b60-9b15e9c54bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:57.238614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f095ca-f809-487e-9b60-9b15e9c54bea None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:57.238897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f095ca-f809-487e-9b60-9b15e9c54bea None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:57.239172 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f095ca-f809-487e-9b60-9b15e9c54bea None admin] PATH_INFO: `/v3/users/bed92113d72b469cbeecbdbd6940bede` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:57.240265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f095ca-f809-487e-9b60-9b15e9c54bea None admin] RBAC: Authorizing `identity:get_user(user_id=bed92113d72b469cbeecbdbd6940bede)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:57.241687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f095ca-f809-487e-9b60-9b15e9c54bea None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:57.243824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 604/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:57 2022] GET /identity/v3/users/bed92113d72b469cbeecbdbd6940bede => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:57.249906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:57.279574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:57.347672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2d6a-806e-4190-970e-a2266d8de96b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:57.381094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6bde6-1ab1-4457-bf50-bc168a48e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:57.381686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6bde6-1ab1-4457-bf50-bc168a48e204 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:57.381995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6bde6-1ab1-4457-bf50-bc168a48e204 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:57.382270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6bde6-1ab1-4457-bf50-bc168a48e204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:57.446880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6bde6-1ab1-4457-bf50-bc168a48e204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:57.448268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6bde6-1ab1-4457-bf50-bc168a48e204 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:57.476529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:57.545186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 594/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:57.551270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f095ca-f809-487e-9b60-9b15e9c54bea None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:57.648925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f095ca-f809-487e-9b60-9b15e9c54bea None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:57.659168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:57.683041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a265-1d82-48d0-ab59-63d859a55496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:57.683651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a265-1d82-48d0-ab59-63d859a55496 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:57.684076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a265-1d82-48d0-ab59-63d859a55496 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:57.684358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a265-1d82-48d0-ab59-63d859a55496 None admin] PATH_INFO: `/v3/projects/d3437032f7354e89974d0fb78220dbbe` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:57.685447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753a265-1d82-48d0-ab59-63d859a55496 None admin] RBAC: Authorizing `identity:get_project(project_id=d3437032f7354e89974d0fb78220dbbe)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:57.686899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753a265-1d82-48d0-ab59-63d859a55496 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:57.688503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 605/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:57 2022] GET /identity/v3/projects/d3437032f7354e89974d0fb78220dbbe => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:57.694673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6bde6-1ab1-4457-bf50-bc168a48e204 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:57.791983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6bde6-1ab1-4457-bf50-bc168a48e204 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:57.819992 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:57.826817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b57fdd-9df2-48e3-9e7c-0db7a4b37ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:57.827413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b57fdd-9df2-48e3-9e7c-0db7a4b37ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:57.827693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b57fdd-9df2-48e3-9e7c-0db7a4b37ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:57.827965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b57fdd-9df2-48e3-9e7c-0db7a4b37ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:57.828683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b57fdd-9df2-48e3-9e7c-0db7a4b37ff7 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=d3437032f7354e89974d0fb78220dbbe, user.id=bed92113d72b469cbeecbdbd6940bede) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:57.828990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b57fdd-9df2-48e3-9e7c-0db7a4b37ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:57.830455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b57fdd-9df2-48e3-9e7c-0db7a4b37ff7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:57.836080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 595/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:57 2022] GET /identity/v3/role_assignments?user.id=bed92113d72b469cbeecbdbd6940bede&scope.project.id=d3437032f7354e89974d0fb78220dbbe&role.id=cac8d7ae8325488684667d62304b0860 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:07.678728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=11 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:07.833499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:53.814808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2b65-dcfc-4195-863b-c71ee8f41795 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:53.815407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2b65-dcfc-4195-863b-c71ee8f41795 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:53.815407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f2b65-dcfc-4195-863b-c71ee8f41795 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:53.816970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 606/1201] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:29:53.824879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3a3a-c42e-48d8-a28e-0ac48f7ee37b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:53.825941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3a3a-c42e-48d8-a28e-0ac48f7ee37b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:53.825941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3a3a-c42e-48d8-a28e-0ac48f7ee37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:53.846803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-773f3a3a-c42e-48d8-a28e-0ac48f7ee37b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:29:53.848058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-773f3a3a-c42e-48d8-a28e-0ac48f7ee37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:29:53.926773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 596/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:29:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:29:54.205433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f2b65-dcfc-4195-863b-c71ee8f41795 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:54.373015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f2b65-dcfc-4195-863b-c71ee8f41795 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:54.419489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:54.420052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:54.420335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:54.420605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:54.435155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:54.436835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:29:54.453686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:54.455018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:29:54.456226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:29:54.456226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:54.456226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:29:54.463278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 607/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:29:54.464356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f3a3a-c42e-48d8-a28e-0ac48f7ee37b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:54.597056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f3a3a-c42e-48d8-a28e-0ac48f7ee37b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:54.636280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:54.644740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a594-7342-4bc2-9f96-0be6b49ed0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:54.645390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a594-7342-4bc2-9f96-0be6b49ed0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:54.645728 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a594-7342-4bc2-9f96-0be6b49ed0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:54.646132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a594-7342-4bc2-9f96-0be6b49ed0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:54.646819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a594-7342-4bc2-9f96-0be6b49ed0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:54.647147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a594-7342-4bc2-9f96-0be6b49ed0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:54.649706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a594-7342-4bc2-9f96-0be6b49ed0c1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:54.668083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 597/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:54.676854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:54.757664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:54.816993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e35c-bc32-476c-9461-1b176bbf47ba None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:54.854408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eefa54-a13a-4b59-9cd0-1132d1a79bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:54.855015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eefa54-a13a-4b59-9cd0-1132d1a79bdd None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:54.855295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eefa54-a13a-4b59-9cd0-1132d1a79bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:54.855559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eefa54-a13a-4b59-9cd0-1132d1a79bdd None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:54.856198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eefa54-a13a-4b59-9cd0-1132d1a79bdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:54.857626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eefa54-a13a-4b59-9cd0-1132d1a79bdd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:54.885486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 608/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 15:29:54 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:29:57.088545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b9e65-bdd7-49ad-8a26-325aa9278ed2 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:57.089114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b9e65-bdd7-49ad-8a26-325aa9278ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:57.089209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b9e65-bdd7-49ad-8a26-325aa9278ed2 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:57.090739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 598/1206] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:29:57.096188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ed29-9737-481d-a453-ddcc6b6e3ff9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:57.096655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ed29-9737-481d-a453-ddcc6b6e3ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:57.096745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ed29-9737-481d-a453-ddcc6b6e3ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:57.115542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5146ed29-9737-481d-a453-ddcc6b6e3ff9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:29:57.116743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5146ed29-9737-481d-a453-ddcc6b6e3ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:29:57.190077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 609/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:29:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:29:57.463844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b9e65-bdd7-49ad-8a26-325aa9278ed2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:57.593458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b9e65-bdd7-49ad-8a26-325aa9278ed2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:57.641699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c9cec-029a-4f7b-bc26-2fbcc8612eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:57.642354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c9cec-029a-4f7b-bc26-2fbcc8612eed None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:57.642641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c9cec-029a-4f7b-bc26-2fbcc8612eed None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:57.642920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c9cec-029a-4f7b-bc26-2fbcc8612eed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:57.654618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c9cec-029a-4f7b-bc26-2fbcc8612eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-7a3c9cec-029a-4f7b-bc26-2fbcc8612eed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:29:57.660152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:57.661137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:29:57.662025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 599/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:29:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:29:57.667496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ed29-9737-481d-a453-ddcc6b6e3ff9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:57.708837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:57.776943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ed29-9737-481d-a453-ddcc6b6e3ff9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:57.813607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:57.814247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:57.814531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:57.814822 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:57.815490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:57.815792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:57.817243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:57.829360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 610/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:29:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:57.835904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c9cec-029a-4f7b-bc26-2fbcc8612eed None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:57.905254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:57.967730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c9cec-029a-4f7b-bc26-2fbcc8612eed None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:58.010548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:58.011282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:58.011595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:58.011870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:58.023145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:58.025221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:29:58.042567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:58.043609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:29:58.044881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:29:58.044881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:58.044881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:29:58.044881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 600/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:29:58.050095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:58.165688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:58.171986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea8c06-f4c1-47d3-a569-2f929dd44ac0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:58.213762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:58.214626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:58.214978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:58.215405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:58.216123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:58.216430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:58.218066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:58.236162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 611/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:29:58.243349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:58.362963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa76063-542e-4740-89c9-503ee4d270f5 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:58.364670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:58.406463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:58.406463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:58.406463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:58.406463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:58.415454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:58.417095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:29:58.430517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:58.431849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:29:58.432873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 601/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:29:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:29:58.437733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:58.562203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7fa9-2bb7-4f10-8f16-08b18bf2ec37 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:58.603292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:58.603979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:58.604267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:58.604538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:58.605260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:58.605563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:58.607056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:58.627759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 612/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 15:29:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:58.635364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:58.760649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a2477-774e-4fe2-99bc-d6a797d24af1 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:58.804036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b926c-0170-4971-94c6-bd19168188e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:58.805295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b926c-0170-4971-94c6-bd19168188e9 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:58.805613 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b926c-0170-4971-94c6-bd19168188e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:58.805920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b926c-0170-4971-94c6-bd19168188e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:58.840005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:58.886910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b926c-0170-4971-94c6-bd19168188e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:58.888441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b926c-0170-4971-94c6-bd19168188e9 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:59.011083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 602/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:29:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:29:59.016779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:59.040024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:59.146989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7e84a-8938-4261-8627-35f96ee00dcc None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:59.201445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:59.202286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:59.204081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:59.204081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:59.218220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:59.219911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:29:59.239891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:59.241047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:29:59.242506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:29:59.242506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:59.242506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:29:59.242506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 613/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:29:59.247381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b926c-0170-4971-94c6-bd19168188e9 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:59.313934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:59.361287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b926c-0170-4971-94c6-bd19168188e9 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:59.399955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:59.400477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:59.400755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:59.401026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:59.401750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:59.402317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:59.403809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:59.416598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 603/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:59.422072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:59.510359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:59.566328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0cdd2-63a2-4ca1-8ed6-ebebf88f27df None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:59.614871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:59.615945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:59.616437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:59.616731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:59.626485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:59.627953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:29:59.640866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:59.641860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:29:59.650746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 614/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:29:59.651282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:59.763508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a076d1-a379-4974-b1fd-9407f6a7e3d4 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:59.788938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:59.808295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96179e9b-4565-4b00-bd2d-5dce233c22e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:59.809238 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96179e9b-4565-4b00-bd2d-5dce233c22e7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:59.809515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96179e9b-4565-4b00-bd2d-5dce233c22e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:59.809786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96179e9b-4565-4b00-bd2d-5dce233c22e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:59.810532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96179e9b-4565-4b00-bd2d-5dce233c22e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:59.810820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96179e9b-4565-4b00-bd2d-5dce233c22e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:59.812263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96179e9b-4565-4b00-bd2d-5dce233c22e7 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:59.827496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 604/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:59.833598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:59.958584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8711c-878f-4380-afb1-31a46703c332 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:59.992234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:00.000467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6adeb-3681-4397-ae4b-a9940854afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:00.001161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6adeb-3681-4397-ae4b-a9940854afd5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:00.001451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6adeb-3681-4397-ae4b-a9940854afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:00.001741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6adeb-3681-4397-ae4b-a9940854afd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:00.002503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6adeb-3681-4397-ae4b-a9940854afd5 None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=5246da8ac5b943d58b1d565cc4658491) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:00.002879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6adeb-3681-4397-ae4b-a9940854afd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:00.004355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6adeb-3681-4397-ae4b-a9940854afd5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:00.011279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 615/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:29:59 2022] GET /identity/v3/role_assignments?user.id=5246da8ac5b943d58b1d565cc4658491&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:01.978714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b06c-2d46-49d6-9de8-b392deb8e90f None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:01.979259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b06c-2d46-49d6-9de8-b392deb8e90f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:01.979259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b06c-2d46-49d6-9de8-b392deb8e90f None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:01.980593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 605/1220] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:01.986610 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e77a1-8287-4059-88b0-bdd462393553 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:01.987309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e77a1-8287-4059-88b0-bdd462393553 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:01.987546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e77a1-8287-4059-88b0-bdd462393553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.011059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1f7e77a1-8287-4059-88b0-bdd462393553 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:02.012567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1f7e77a1-8287-4059-88b0-bdd462393553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:02.084321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 616/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:02.391761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5b06c-2d46-49d6-9de8-b392deb8e90f None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:02.502635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5b06c-2d46-49d6-9de8-b392deb8e90f None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:02.543549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73064-03c5-4cb1-847b-fd73404505aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:02.544212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73064-03c5-4cb1-847b-fd73404505aa None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:02.544490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73064-03c5-4cb1-847b-fd73404505aa None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:02.544761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73064-03c5-4cb1-847b-fd73404505aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.557351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f73064-03c5-4cb1-847b-fd73404505aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b0f73064-03c5-4cb1-847b-fd73404505aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:02.562749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:02.565954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:02.567040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 606/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:30:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:02.570638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e77a1-8287-4059-88b0-bdd462393553 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:02.676138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e77a1-8287-4059-88b0-bdd462393553 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:02.701635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:02.717121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:02.717890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:02.718182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:02.718455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.719120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:02.719448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:02.720812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:02.729283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 617/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:30:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:02.736061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73064-03c5-4cb1-847b-fd73404505aa None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:02.785811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:02.843124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73064-03c5-4cb1-847b-fd73404505aa None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:02.880476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:02.881189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:02.881545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:02.881823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.893705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:02.895214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:02.909767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:02.910963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:02.912227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:02.912227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:02.912227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:02.912227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 607/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:02.916983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:03.030583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bfa77-a483-4250-95a9-2fe918ff1a82 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:03.072910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:03.073523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:03.073824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:03.074145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:03.074797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:03.075107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:03.076545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:03.089205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 618/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:03.094971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:03.200984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:03.208375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2a198-d0ff-449d-8a15-5bfc1a4e6f1b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:03.246011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:03.246646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:03.246935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:03.247206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:03.255538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:03.257188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:03.270711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:03.271893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:03.273061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 608/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:03.278813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:03.331936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:03.394045 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9dc17-b070-4c84-bdb8-64d6e6f289ef None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:03.431349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:03.431966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:03.432320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:03.432599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:03.433332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:03.433639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:03.435115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:03.459593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 619/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:03.461361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:03.580831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482484e3-ecd4-4e74-98b0-af097d887de8 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:03.621460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:03.622085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:03.622397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:03.622638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:03.635148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:03.636622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:03.652524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:03.653752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:03.659798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:03.659798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:03.659798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:03.659798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 609/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:30:03.660146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:03.777966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2376ab7-b67f-4975-8f00-2bbc687aad2e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:03.781140 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:03.816919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:03.817508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:03.817798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:03.818101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:03.818734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:03.819066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:03.821039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:03.832975 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 620/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:03.839370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:03.848882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:03.951477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe306-9d63-4761-a573-6415cf5d4c74 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:03.988507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:03.989236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:03.989412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:03.989688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:03.998214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:03.999663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:04.011508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:04.012632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:04.013977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 610/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:04.018761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:04.130965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f03fc0-71f7-47f9-8867-b537e8ee8f51 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:04.173534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59e9d-5b51-4fa0-8591-a1833d9f21db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:04.174161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59e9d-5b51-4fa0-8591-a1833d9f21db None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:04.174499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59e9d-5b51-4fa0-8591-a1833d9f21db None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:04.174774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59e9d-5b51-4fa0-8591-a1833d9f21db None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:04.175545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f59e9d-5b51-4fa0-8591-a1833d9f21db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:04.175852 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f59e9d-5b51-4fa0-8591-a1833d9f21db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:04.177295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f59e9d-5b51-4fa0-8591-a1833d9f21db None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:04.190740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 621/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:04.197509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:04.268420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:04.306612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2e9c3-ce65-4c53-8244-8a0dbe0b2c1b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:04.342774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001c640-3e76-4080-b778-4dd73741981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:04.343510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001c640-3e76-4080-b778-4dd73741981c None admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:04.343765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001c640-3e76-4080-b778-4dd73741981c None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:04.344044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001c640-3e76-4080-b778-4dd73741981c None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/5246da8ac5b943d58b1d565cc4658491/roles/ea03b7919cca4616936c45ad11b68389` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:04.360373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001c640-3e76-4080-b778-4dd73741981c None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=5246da8ac5b943d58b1d565cc4658491, role_id=ea03b7919cca4616936c45ad11b68389)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:04.362152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001c640-3e76-4080-b778-4dd73741981c None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:04.376928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 611/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:30:04 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/5246da8ac5b943d58b1d565cc4658491/roles/ea03b7919cca4616936c45ad11b68389 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:30:06.373817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111ba6b-476a-4645-bfbe-10c596d73649 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:06.374374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111ba6b-476a-4645-bfbe-10c596d73649 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:06.374374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111ba6b-476a-4645-bfbe-10c596d73649 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:06.375743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 622/1233] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:06.381192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb825-c74b-49b0-bbdd-371c65b21ada None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:06.381639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb825-c74b-49b0-bbdd-371c65b21ada None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:06.381746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb825-c74b-49b0-bbdd-371c65b21ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:06.402175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e4ebb825-c74b-49b0-bbdd-371c65b21ada None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:06.403378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e4ebb825-c74b-49b0-bbdd-371c65b21ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:06.480246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 612/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:06.769552 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111ba6b-476a-4645-bfbe-10c596d73649 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:06.796753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:06.883037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111ba6b-476a-4645-bfbe-10c596d73649 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:06.922189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2e7f-b522-458e-ad24-361038c36cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:06.922996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2e7f-b522-458e-ad24-361038c36cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:06.923359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2e7f-b522-458e-ad24-361038c36cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:06.923758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2e7f-b522-458e-ad24-361038c36cc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:06.936138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a2e7f-b522-458e-ad24-361038c36cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f37a2e7f-b522-458e-ad24-361038c36cc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:06.941130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:06.942618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:06.943750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 623/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 15:30:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:06.949902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebb825-c74b-49b0-bbdd-371c65b21ada None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.001257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:07.064637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebb825-c74b-49b0-bbdd-371c65b21ada None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:07.103815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:07.104428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:07.104714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:07.104984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:07.105828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] RBAC: Adding query filter params (name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:07.106254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:07.107650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.116609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 613/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 15:30:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:07.123455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2e7f-b522-458e-ad24-361038c36cc6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.216518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:07.236466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2e7f-b522-458e-ad24-361038c36cc6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:07.280327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:07.281027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:07.281318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:07.281634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:07.292535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:07.294021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:07.310251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:07.311425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:07.312545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:07.312545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:07.312545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:07.317086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 624/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:07.317859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.435127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed76b-5270-4bfb-b650-4521829cca88 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:07.445004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:07.474899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:07.475577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:07.475786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:07.476060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:07.477310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:07.477642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:07.479073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.491642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 614/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:07.498037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.616133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07531f1-da59-4b21-afa7-1c2cda3feb81 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:07.652580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:07.653223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:07.653496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:07.653768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:07.656826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:07.662465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:07.664684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:07.676200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:07.677377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:07.678671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 625/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:07.683970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.791457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167140c8-3cb9-47c3-a441-2fd95fd98335 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:07.827053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:07.827807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:07.828152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:07.828481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:07.829350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:07.829793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:07.831690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.850165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 615/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:07.858095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.977548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae8470-e2f9-4de2-8d16-a522ef8df811 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:08.017485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e0d1b-a64d-4f34-bed1-b6732fb4a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:08.018143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0d1b-a64d-4f34-bed1-b6732fb4a60e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:08.018418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0d1b-a64d-4f34-bed1-b6732fb4a60e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:08.018692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e0d1b-a64d-4f34-bed1-b6732fb4a60e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:08.091673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:08.098773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e0d1b-a64d-4f34-bed1-b6732fb4a60e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:08.100240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e0d1b-a64d-4f34-bed1-b6732fb4a60e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:08.213935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 626/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:30:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:30:08.220222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:08.253925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:08.333549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4977-f3d1-4e58-bfc6-9826e7096a49 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:08.372217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:08.372851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:08.373131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:08.373404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:08.384339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:08.385949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:08.402042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:08.403274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:08.404300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:08.404300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:08.404300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:08.404300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 616/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:08.409826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e0d1b-a64d-4f34-bed1-b6732fb4a60e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:08.510813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:08.517365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e0d1b-a64d-4f34-bed1-b6732fb4a60e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:08.556493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:08.557175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:08.557475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:08.557890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:08.558625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:08.558971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:08.560503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:08.573027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 627/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:08.578846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:08.669236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:08.697341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991001-878a-463e-965d-daaf8c2f39f6 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:08.740143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:08.740851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:08.741136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:08.741412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:08.748191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:08.749624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:08.762112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:08.763253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:08.764337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 617/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:08.769527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:08.899568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa738-a149-4ad6-ab80-958cdcaff574 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:08.936540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a98fdd-fcb1-4770-b26e-51373475e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:08.937152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98fdd-fcb1-4770-b26e-51373475e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:08.937433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98fdd-fcb1-4770-b26e-51373475e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:08.937705 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98fdd-fcb1-4770-b26e-51373475e8c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:08.938428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a98fdd-fcb1-4770-b26e-51373475e8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:08.938736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a98fdd-fcb1-4770-b26e-51373475e8c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:08.940193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a98fdd-fcb1-4770-b26e-51373475e8c4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:08.954422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 628/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:08.962650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:09.080725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28fabc-2be8-4e56-9450-7594f56a7f26 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:09.117950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae0661-3d41-46ef-a6c2-033f21d09209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:09.118587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0661-3d41-46ef-a6c2-033f21d09209 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:09.118897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0661-3d41-46ef-a6c2-033f21d09209 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:09.119177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae0661-3d41-46ef-a6c2-033f21d09209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:09.119880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0661-3d41-46ef-a6c2-033f21d09209 None admin] RBAC: Adding query filter params (role.id=ea03b7919cca4616936c45ad11b68389, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=5246da8ac5b943d58b1d565cc4658491) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:09.120187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0661-3d41-46ef-a6c2-033f21d09209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:09.121657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae0661-3d41-46ef-a6c2-033f21d09209 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:09.128590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 618/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:30:08 2022] GET /identity/v3/role_assignments?user.id=5246da8ac5b943d58b1d565cc4658491&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=ea03b7919cca4616936c45ad11b68389 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:11.387395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5bac-27ed-4245-97bb-ae540effe34b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:11.387967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5bac-27ed-4245-97bb-ae540effe34b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:11.387967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5bac-27ed-4245-97bb-ae540effe34b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:11.389356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 629/1247] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:11.395087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b23d-1313-4086-b5fb-466952980eed None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:11.395614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b23d-1313-4086-b5fb-466952980eed None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:11.395879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b23d-1313-4086-b5fb-466952980eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:11.403883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:11.416544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-16f0b23d-1313-4086-b5fb-466952980eed None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:11.417731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-16f0b23d-1313-4086-b5fb-466952980eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:11.488551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 619/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:11.760509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef5bac-27ed-4245-97bb-ae540effe34b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:11.780651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:11.877426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef5bac-27ed-4245-97bb-ae540effe34b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:11.916195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad60c3-cb63-4d80-9860-7734997ea57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:11.916832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad60c3-cb63-4d80-9860-7734997ea57a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:11.917114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad60c3-cb63-4d80-9860-7734997ea57a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:11.917438 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad60c3-cb63-4d80-9860-7734997ea57a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:11.930402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad60c3-cb63-4d80-9860-7734997ea57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-23ad60c3-cb63-4d80-9860-7734997ea57a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:11.935766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:11.936808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:11.937733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 630/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:11.943294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b23d-1313-4086-b5fb-466952980eed None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.081771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b23d-1313-4086-b5fb-466952980eed None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.118936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:12.124459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.125080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.125389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.125668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.126376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:12.126682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.128070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.137629 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 620/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:12.143407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad60c3-cb63-4d80-9860-7734997ea57a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.229171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:12.254313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad60c3-cb63-4d80-9860-7734997ea57a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.293163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.293792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.294101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.294381 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.305576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.307089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:12.322200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:12.323550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:12.324646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:12.324646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:12.324646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:12.324646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 631/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:30:12.329470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.439023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad14c0-34bd-43a8-bbe9-f729a710477b None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.473227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.473860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.474145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.474421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.475058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:12.475365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.477536 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.495449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 621/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:12.496833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.610322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ba4aa-c478-4af0-b41f-f2d6a36f0588 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.640568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:12.650040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.650752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.651107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.651392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.659522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.661004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:12.673059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:12.674219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:12.675296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 632/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:12.680835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.745669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:12.793420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6658-5e6f-4740-885a-c0a3b3dcc93a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.829612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.830403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.830816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.831252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.832380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:12.832813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.834751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.862213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 622/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:12.863537 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.968153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264496-15bf-4216-88c0-41f99190711e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:13.002513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07414ba-b490-46fb-bf72-f6f9e5731212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:13.003043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07414ba-b490-46fb-bf72-f6f9e5731212 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:13.003324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07414ba-b490-46fb-bf72-f6f9e5731212 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:13.003593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07414ba-b490-46fb-bf72-f6f9e5731212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:13.067899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:13.084075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07414ba-b490-46fb-bf72-f6f9e5731212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:13.086098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07414ba-b490-46fb-bf72-f6f9e5731212 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:13.207585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 633/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:30:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 15:30:13.213487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:13.346657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f97cd-2978-4f56-8b26-03ca1e805331 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:13.364474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:13.390751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:13.391395 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:13.391673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:13.391943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:13.405081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:13.407990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:13.429969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:13.431129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:13.432174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:13.432174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:13.432174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:13.432174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 623/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:13.438268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07414ba-b490-46fb-bf72-f6f9e5731212 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:13.555267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:13.574171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07414ba-b490-46fb-bf72-f6f9e5731212 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:13.615059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:13.615606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:13.615892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:13.616213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:13.616901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:13.617302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:13.619030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:13.631451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 634/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:13.639377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:13.754423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a06b5-b0da-4941-a4d7-895067a89760 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:13.791221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:13.791854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:13.792140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:13.792413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:13.799202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:13.800918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:13.813444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:13.814576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:13.815516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 624/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:13.822773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:13.938310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92d85-7ef2-46ca-bd59-160cdd14c7d7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:13.976260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93754bb5-a707-4678-89a1-c8dbf2dbec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:13.976971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754bb5-a707-4678-89a1-c8dbf2dbec09 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:13.977258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754bb5-a707-4678-89a1-c8dbf2dbec09 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:13.977533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754bb5-a707-4678-89a1-c8dbf2dbec09 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:13.978260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93754bb5-a707-4678-89a1-c8dbf2dbec09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:13.978569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93754bb5-a707-4678-89a1-c8dbf2dbec09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:13.980010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93754bb5-a707-4678-89a1-c8dbf2dbec09 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:13.993631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 635/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:13.999767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:14.029298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:14.112093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965ecae-dd0a-4b15-8069-8dc10cb86361 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:14.155121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122e728-94fa-4ecd-9031-c6dfcc7a6f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:14.155738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e728-94fa-4ecd-9031-c6dfcc7a6f0d None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:14.156016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e728-94fa-4ecd-9031-c6dfcc7a6f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:14.156287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e728-94fa-4ecd-9031-c6dfcc7a6f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:14.157023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122e728-94fa-4ecd-9031-c6dfcc7a6f0d None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=5246da8ac5b943d58b1d565cc4658491) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:14.157331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122e728-94fa-4ecd-9031-c6dfcc7a6f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:14.158820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122e728-94fa-4ecd-9031-c6dfcc7a6f0d None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:14.165423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 625/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:30:13 2022] GET /identity/v3/role_assignments?user.id=5246da8ac5b943d58b1d565cc4658491&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=cac8d7ae8325488684667d62304b0860 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:16.092562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799981-b04c-4ba6-bc9f-4b992913edf4 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.093218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799981-b04c-4ba6-bc9f-4b992913edf4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.093218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799981-b04c-4ba6-bc9f-4b992913edf4 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.094484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 636/1261] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:16.099477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ff5c-61f5-4083-87e6-1d492a40e212 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.099897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ff5c-61f5-4083-87e6-1d492a40e212 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.100035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ff5c-61f5-4083-87e6-1d492a40e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.120823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e508ff5c-61f5-4083-87e6-1d492a40e212 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:16.123557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e508ff5c-61f5-4083-87e6-1d492a40e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:16.190567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 626/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:16.471458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77799981-b04c-4ba6-bc9f-4b992913edf4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:16.482878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:16.582675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77799981-b04c-4ba6-bc9f-4b992913edf4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:16.615889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0be4ab-7655-46cb-ac89-5e33564a7b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:16.616498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be4ab-7655-46cb-ac89-5e33564a7b24 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.617608 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be4ab-7655-46cb-ac89-5e33564a7b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.617963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be4ab-7655-46cb-ac89-5e33564a7b24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.628813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0be4ab-7655-46cb-ac89-5e33564a7b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4b0be4ab-7655-46cb-ac89-5e33564a7b24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:16.634285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:16.635528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:16.636725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 637/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:30:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:16.641464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ff5c-61f5-4083-87e6-1d492a40e212 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:16.660149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:16.740035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ff5c-61f5-4083-87e6-1d492a40e212 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:16.773919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:16.774515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.774796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.775068 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.775761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:16.776128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:16.777521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:16.785444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 627/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:16.791118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0be4ab-7655-46cb-ac89-5e33564a7b24 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:16.856492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:16.889576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0be4ab-7655-46cb-ac89-5e33564a7b24 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:16.921659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:16.922301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.922580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.922851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.933152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:16.934617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:16.949248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:16.950444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:16.951578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:16.951578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:16.951578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:16.951578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 638/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:16.956149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:17.035650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:17.054826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25013f20-e7ec-4e69-bfcd-76f6b9192c5e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:17.091308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:17.091919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:17.092197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:17.092468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:17.093111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:17.093412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:17.094821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:17.106989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 628/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:17.112914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:17.211874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2599a-5ac6-478e-a84b-2ac616c8c368 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:17.231242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:17.245670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:17.246320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:17.246601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:17.246873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:17.254808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:17.256233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:17.266958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:17.268089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:17.269254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 639/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:17.273903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:17.371853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e89a-d826-4fb5-8c3a-09958bc318fd None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:17.405796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:17.406425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:17.406709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:17.407002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:17.407707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:17.408014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:17.409441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:17.418136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:17.426901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 629/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:17.432564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:17.545082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7886f-d9d0-40f3-9e10-a2d4bd5cd499 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:17.577956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:17.578572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:17.578853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:17.579126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:17.590085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:17.591533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:17.605079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:17.606192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:17.607305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:17.607305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:17.607305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:17.607305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 640/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:17.612321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:17.710911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2212e4-b4ab-4ce0-92fd-16f18bb81c1e None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:17.743721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:17.744312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:17.744590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:17.744863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:17.745494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:17.745793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:17.747193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:17.758706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 630/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:17.764321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:17.795189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:17.865403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7f5a9-74cb-4d5e-92e7-4cc155057b24 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:17.897095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:17.898251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:17.898536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:17.898805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:17.905158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:17.906601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:17.918057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:17.919125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:17.920382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 641/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:17.924950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:17.982499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:18.025294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea50f-35b0-4c49-a5c8-1fc4c8feb2c8 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:18.058279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82f61f-1275-4681-bd8a-4cd76083a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:18.058875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f61f-1275-4681-bd8a-4cd76083a463 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:18.059155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f61f-1275-4681-bd8a-4cd76083a463 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:18.059426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82f61f-1275-4681-bd8a-4cd76083a463 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:18.060108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82f61f-1275-4681-bd8a-4cd76083a463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:18.060413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82f61f-1275-4681-bd8a-4cd76083a463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:18.061872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82f61f-1275-4681-bd8a-4cd76083a463 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:18.074141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 631/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:18.080181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:18.173311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:18.182919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e67f-78c4-4d1b-b97b-a54ff5d333ab None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:18.215232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217a29f-1d04-42b9-9bb3-03e3cf2e0908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:18.215881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a29f-1d04-42b9-9bb3-03e3cf2e0908 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:18.216162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a29f-1d04-42b9-9bb3-03e3cf2e0908 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:18.216436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217a29f-1d04-42b9-9bb3-03e3cf2e0908 None admin] PATH_INFO: `/v3/projects/869b42f452de4211a9430e6cf453f862/users/5246da8ac5b943d58b1d565cc4658491/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:18.218333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217a29f-1d04-42b9-9bb3-03e3cf2e0908 None admin] RBAC: Authorizing `identity:create_grant(project_id=869b42f452de4211a9430e6cf453f862, user_id=5246da8ac5b943d58b1d565cc4658491, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:18.219768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217a29f-1d04-42b9-9bb3-03e3cf2e0908 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:18.232405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 642/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 15:30:18 2022] PUT /identity/v3/projects/869b42f452de4211a9430e6cf453f862/users/5246da8ac5b943d58b1d565cc4658491/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:30:20.158798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174f2a1-0953-4c04-bdc4-c43b33f45efd None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.159303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174f2a1-0953-4c04-bdc4-c43b33f45efd None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.159414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174f2a1-0953-4c04-bdc4-c43b33f45efd None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.160697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 632/1274] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:20.165960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b7367-1f94-477d-99c9-67a3976cd369 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.166393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b7367-1f94-477d-99c9-67a3976cd369 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.166500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b7367-1f94-477d-99c9-67a3976cd369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.185546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-053b7367-1f94-477d-99c9-67a3976cd369 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:20.186803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-053b7367-1f94-477d-99c9-67a3976cd369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:20.253657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 643/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:20.525811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174f2a1-0953-4c04-bdc4-c43b33f45efd None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:20.643106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174f2a1-0953-4c04-bdc4-c43b33f45efd None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:20.660286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:20.677699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e291-41fe-406e-829f-d9542314ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:20.678385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e291-41fe-406e-829f-d9542314ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.678665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e291-41fe-406e-829f-d9542314ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.678962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0e291-41fe-406e-829f-d9542314ffc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.688951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0e291-41fe-406e-829f-d9542314ffc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-95c0e291-41fe-406e-829f-d9542314ffc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:20.693608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:20.694817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:20.695712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 633/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 15:30:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:20.700904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b7367-1f94-477d-99c9-67a3976cd369 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:20.780525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:20.799376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b7367-1f94-477d-99c9-67a3976cd369 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:20.832389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:20.832990 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.833272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.833547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.834250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:20.834558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:20.836578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:20.844351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 644/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 15:30:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:20.850064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e291-41fe-406e-829f-d9542314ffc7 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:20.949247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0e291-41fe-406e-829f-d9542314ffc7 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:20.982571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:20.983193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.983472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.983746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.994450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:20.995898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:21.010116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:21.011222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:21.012403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:21.012403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:21.012403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:21.012403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 634/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:21.017336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:21.115631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe24a9-1a7b-4547-a3de-1aa3af277d1a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:21.149225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:21.149826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:21.150136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:21.150411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:21.151048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:21.151352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:21.152737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:21.164277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 645/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:21.170103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:21.201401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:21.270425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6f2e-850b-44d4-94b0-47288a95d2ec None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:21.303313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:21.303937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:21.304213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:21.304482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:21.311720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:21.313152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:21.324498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:21.325659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:21.326712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 635/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:21.331628 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:21.335957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:21.431401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7eda2-b2ae-4f50-a9e4-c62e80573727 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:21.464485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:21.465078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:21.465356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:21.465627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:21.466367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:21.466671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:21.468083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:21.484433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 646/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:21.490626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:21.588566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:21.598113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e999f8-c20b-4887-b665-78f732c83758 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:21.631694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065c69f-0e7b-4ef2-b7af-21bc7da73a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:21.633357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065c69f-0e7b-4ef2-b7af-21bc7da73a6f None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:21.633640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065c69f-0e7b-4ef2-b7af-21bc7da73a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:21.633972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065c69f-0e7b-4ef2-b7af-21bc7da73a6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:21.701601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065c69f-0e7b-4ef2-b7af-21bc7da73a6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:21.703003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065c69f-0e7b-4ef2-b7af-21bc7da73a6f None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:21.790402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:21.800633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 636/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 15:30:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:30:21.807518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:21.867553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:21.905983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3675685-2416-4526-ba90-67cff23a2127 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:21.938655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:21.939277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:21.939556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:21.939827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:21.950119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:21.951550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:21.966246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:21.967344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:21.968667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:21.968667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:21.968667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:21.968667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 647/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:21.973040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065c69f-0e7b-4ef2-b7af-21bc7da73a6f None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:22.070426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065c69f-0e7b-4ef2-b7af-21bc7da73a6f None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:22.106186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:22.106783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:22.107059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:22.107327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:22.107951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:22.108249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:22.109604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:22.121566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 637/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:22.127333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:22.226731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54058eab-9754-4fb7-92aa-df91749d57f1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:22.240430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:22.260576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:22.261198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:22.261477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:22.261748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:22.268213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:22.269650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:22.282152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:22.283216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:22.284125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:22.284125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:22.284125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:22.284125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:22.284125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:22.284125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:22.284125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:22.284125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: ERROR keystone.server.flask.application Aug 26 15:30:22.286020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 648/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:22.289798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:22.338743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:22.388626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a23f77-e043-4b4c-812a-ddfc4a1e87cd None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:22.421559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9c470-fda8-400d-80cb-2a6bbd682973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:22.422171 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9c470-fda8-400d-80cb-2a6bbd682973 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:22.422450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9c470-fda8-400d-80cb-2a6bbd682973 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:22.422717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9c470-fda8-400d-80cb-2a6bbd682973 None admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:22.423395 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9c470-fda8-400d-80cb-2a6bbd682973 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:22.423692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9c470-fda8-400d-80cb-2a6bbd682973 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:22.425108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9c470-fda8-400d-80cb-2a6bbd682973 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:22.437291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 638/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:22.443393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:22.546188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f870bc-590c-4a73-aaf7-43321c5041ad None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:22.595115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127186ea-9563-4704-8104-dfe039874cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:22.595709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127186ea-9563-4704-8104-dfe039874cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:22.595984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127186ea-9563-4704-8104-dfe039874cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:22.596251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127186ea-9563-4704-8104-dfe039874cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:22.596958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127186ea-9563-4704-8104-dfe039874cd7 None admin] RBAC: Adding query filter params (role.id=cac8d7ae8325488684667d62304b0860, scope.project.id=869b42f452de4211a9430e6cf453f862, user.id=5246da8ac5b943d58b1d565cc4658491) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:22.597261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127186ea-9563-4704-8104-dfe039874cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:22.598711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127186ea-9563-4704-8104-dfe039874cd7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:22.605146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 649/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 15:30:22 2022] GET /identity/v3/role_assignments?user.id=5246da8ac5b943d58b1d565cc4658491&scope.project.id=869b42f452de4211a9430e6cf453f862&role.id=cac8d7ae8325488684667d62304b0860 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:24.553403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae72c9-e637-4c67-8c55-9a1ca14042fb None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:24.553941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae72c9-e637-4c67-8c55-9a1ca14042fb None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:24.554136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae72c9-e637-4c67-8c55-9a1ca14042fb None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:24.555757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 639/1288] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:24.560737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a48c-9ac2-42da-9503-c15c78424580 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:24.561500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a48c-9ac2-42da-9503-c15c78424580 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:24.561790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a48c-9ac2-42da-9503-c15c78424580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:24.579623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b420a48c-9ac2-42da-9503-c15c78424580 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:24.580805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b420a48c-9ac2-42da-9503-c15c78424580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:24.611533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:24.650056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 650/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:24.920987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae72c9-e637-4c67-8c55-9a1ca14042fb None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:25.022201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae72c9-e637-4c67-8c55-9a1ca14042fb None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:25.033014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:25.059363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:25.059991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:25.060270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:25.060537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:25.061107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:25.062505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:25.071353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:25.072476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:25.073853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 640/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:30:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:25.078512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420a48c-9ac2-42da-9503-c15c78424580 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:25.178158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420a48c-9ac2-42da-9503-c15c78424580 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:25.212104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955e986-6d51-4c9c-8e47-6827da93a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:25.212697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e986-6d51-4c9c-8e47-6827da93a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:25.212972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e986-6d51-4c9c-8e47-6827da93a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:25.213238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955e986-6d51-4c9c-8e47-6827da93a7f6 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:25.213874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955e986-6d51-4c9c-8e47-6827da93a7f6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:25.214176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955e986-6d51-4c9c-8e47-6827da93a7f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:25.215526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955e986-6d51-4c9c-8e47-6827da93a7f6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:25.220197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 651/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 26 15:30:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:25.226920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:25.325302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e45b1-af66-4caf-bc6f-78939f38eb30 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:25.359863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c297c8-de6c-4c70-a78a-56d57b9678f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:25.360461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c297c8-de6c-4c70-a78a-56d57b9678f4 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:25.360744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c297c8-de6c-4c70-a78a-56d57b9678f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:25.361021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c297c8-de6c-4c70-a78a-56d57b9678f4 None admin] PATH_INFO: `/v3/services` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:25.361648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c297c8-de6c-4c70-a78a-56d57b9678f4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:25.362248 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c297c8-de6c-4c70-a78a-56d57b9678f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:25.363626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c297c8-de6c-4c70-a78a-56d57b9678f4 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:25.368573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 641/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 26 15:30:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:27.330361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e4aef-119c-48ed-a927-4704049beaff None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:27.330920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e4aef-119c-48ed-a927-4704049beaff None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:27.330920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e4aef-119c-48ed-a927-4704049beaff None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:27.332461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 652/1293] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:27.339471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d934ab9-cf7e-4d10-babe-f20be2dcd537 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:27.339922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d934ab9-cf7e-4d10-babe-f20be2dcd537 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:27.340035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d934ab9-cf7e-4d10-babe-f20be2dcd537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:27.359417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-5d934ab9-cf7e-4d10-babe-f20be2dcd537 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:27.360810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5d934ab9-cf7e-4d10-babe-f20be2dcd537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:27.396130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:27.435060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 642/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:27.781029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e4aef-119c-48ed-a927-4704049beaff None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:27.819895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:27.909445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e4aef-119c-48ed-a927-4704049beaff None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:27.955754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527ebfa-8260-448e-9242-795f014b4a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:27.956735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ebfa-8260-448e-9242-795f014b4a2e None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:27.957225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ebfa-8260-448e-9242-795f014b4a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:27.957728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ebfa-8260-448e-9242-795f014b4a2e None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:27.958945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527ebfa-8260-448e-9242-795f014b4a2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:27.960612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527ebfa-8260-448e-9242-795f014b4a2e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:27.974533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 653/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 15:30:27 2022] POST /identity/v3/services => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:30:29.926817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997664e-b0ad-4a4d-b4d7-a813ec5af336 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:29.927353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997664e-b0ad-4a4d-b4d7-a813ec5af336 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:29.927353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997664e-b0ad-4a4d-b4d7-a813ec5af336 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:29.928707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 643/1296] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:29.934239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627115a-12a8-4d6e-a89f-e06549b16d4f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:29.934691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627115a-12a8-4d6e-a89f-e06549b16d4f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:29.934786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627115a-12a8-4d6e-a89f-e06549b16d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:29.952476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1627115a-12a8-4d6e-a89f-e06549b16d4f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:29.953655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1627115a-12a8-4d6e-a89f-e06549b16d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:30.025904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 654/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:30.309344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997664e-b0ad-4a4d-b4d7-a813ec5af336 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:30.410680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997664e-b0ad-4a4d-b4d7-a813ec5af336 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:30.443586 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:30.444217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:30.445165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:30.445560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:30.446198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:30.447573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:30.456084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:30.457263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:30.458568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 644/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:30:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:30.463493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627115a-12a8-4d6e-a89f-e06549b16d4f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:30.481582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:30.571435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627115a-12a8-4d6e-a89f-e06549b16d4f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:30.609566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b19aad-3935-4739-acca-138af750580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:30.610215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b19aad-3935-4739-acca-138af750580b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:30.610490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b19aad-3935-4739-acca-138af750580b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:30.610763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b19aad-3935-4739-acca-138af750580b None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:30.611385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b19aad-3935-4739-acca-138af750580b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:30.611681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b19aad-3935-4739-acca-138af750580b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:30.613308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b19aad-3935-4739-acca-138af750580b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:30.619192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 655/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 26 15:30:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:30.625270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:30.661898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:30.729461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506369cb-1dac-4ce7-bfc4-11817b21e231 None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:30.763684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd8fbf-1fed-4fa9-aa8a-afa4c09f393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:30.764283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd8fbf-1fed-4fa9-aa8a-afa4c09f393e None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:30.764564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd8fbf-1fed-4fa9-aa8a-afa4c09f393e None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:30.764836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd8fbf-1fed-4fa9-aa8a-afa4c09f393e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:30.765531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd8fbf-1fed-4fa9-aa8a-afa4c09f393e None admin] RBAC: Adding query filter params (interface=public, service_id=31f2d6b214384445bafab0ddf8a2eb26, region_id=RegionOne) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:30.765853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd8fbf-1fed-4fa9-aa8a-afa4c09f393e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:30.767232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd8fbf-1fed-4fa9-aa8a-afa4c09f393e None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:30.772147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 645/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 15:30:30 2022] GET /identity/v3/endpoints?service_id=31f2d6b214384445bafab0ddf8a2eb26&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:30.778719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b19aad-3935-4739-acca-138af750580b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:30.857631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:30.875869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b19aad-3935-4739-acca-138af750580b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:30.909561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f8c43-869e-4dd9-b3e7-e0f0421a3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:30.910208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8c43-869e-4dd9-b3e7-e0f0421a3a03 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:30.910491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8c43-869e-4dd9-b3e7-e0f0421a3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:30.910765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f8c43-869e-4dd9-b3e7-e0f0421a3a03 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:30.911362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f8c43-869e-4dd9-b3e7-e0f0421a3a03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:30.912728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f8c43-869e-4dd9-b3e7-e0f0421a3a03 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:30.919666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 656/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 15:30:30 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:30:32.819007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31165b-9c1b-4593-bb89-1f1a3e53fcd6 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:32.819692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31165b-9c1b-4593-bb89-1f1a3e53fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:32.819692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31165b-9c1b-4593-bb89-1f1a3e53fcd6 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:32.821475 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 646/1302] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:32.826803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b39f-a0cf-49f6-923a-2937b5ec459d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:32.827259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b39f-a0cf-49f6-923a-2937b5ec459d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:32.827359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b39f-a0cf-49f6-923a-2937b5ec459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:32.845614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5d19b39f-a0cf-49f6-923a-2937b5ec459d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:32.846844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5d19b39f-a0cf-49f6-923a-2937b5ec459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:32.911738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 657/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:33.192197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31165b-9c1b-4593-bb89-1f1a3e53fcd6 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:33.288959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:33.297381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31165b-9c1b-4593-bb89-1f1a3e53fcd6 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:33.334170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:33.334808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:33.335840 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:33.336034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:33.336536 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:33.337924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:33.346405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:33.350028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: ERROR keystone.server.flask.application Aug 26 15:30:33.351138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 647/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 15:30:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:33.354010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19b39f-a0cf-49f6-923a-2937b5ec459d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:33.428434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:33.453033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19b39f-a0cf-49f6-923a-2937b5ec459d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:33.485379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8383bd-fbf5-48c0-bc93-edeabb80a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:33.486004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8383bd-fbf5-48c0-bc93-edeabb80a777 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:33.486286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8383bd-fbf5-48c0-bc93-edeabb80a777 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:33.486560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8383bd-fbf5-48c0-bc93-edeabb80a777 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:33.487446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8383bd-fbf5-48c0-bc93-edeabb80a777 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:33.487745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8383bd-fbf5-48c0-bc93-edeabb80a777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:33.489102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8383bd-fbf5-48c0-bc93-edeabb80a777 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:33.495306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 658/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 26 15:30:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:33.501436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:33.598563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b350a-1fb6-4699-8c0e-e261554d028a None admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:33.632678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f46786-35a1-411c-bcae-3585012cea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:33.633334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46786-35a1-411c-bcae-3585012cea91 None admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:33.633616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46786-35a1-411c-bcae-3585012cea91 None admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:33.633927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f46786-35a1-411c-bcae-3585012cea91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:33.634592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f46786-35a1-411c-bcae-3585012cea91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:33.635967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f46786-35a1-411c-bcae-3585012cea91 None admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:33.654884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 648/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:30:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:30:43.491639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=30 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:43.650608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:39.056945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605438e-e67f-41c7-bb50-e077a5d422d9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:39.057527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605438e-e67f-41c7-bb50-e077a5d422d9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:39.057762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605438e-e67f-41c7-bb50-e077a5d422d9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:39.063169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 659/1307] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:31:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:39.064508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aba07-e5d4-4d82-b3fe-cb380182384d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:39.064957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aba07-e5d4-4d82-b3fe-cb380182384d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:39.065122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aba07-e5d4-4d82-b3fe-cb380182384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:39.231525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-f01aba07-e5d4-4d82-b3fe-cb380182384d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:39.232778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f01aba07-e5d4-4d82-b3fe-cb380182384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:39.445900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 649/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:31:39.745768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc807-2bfc-42bf-802c-de0e32614ce2 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:39.746333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc807-2bfc-42bf-802c-de0e32614ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:39.746765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc807-2bfc-42bf-802c-de0e32614ce2 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:39.748521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 660/1309] 10.222.0.20 () {54 vars in 965 bytes} [Fri Aug 26 15:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:39.754729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15bb1-be00-4c96-946c-f563a242cb9d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:39.755188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15bb1-be00-4c96-946c-f563a242cb9d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:39.755579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d15bb1-be00-4c96-946c-f563a242cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:39.844232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-54d15bb1-be00-4c96-946c-f563a242cb9d None None] MFA Rules not processed for user `9962d812513a428b99ada1f79a5b88d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:39.845750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-54d15bb1-be00-4c96-946c-f563a242cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:39.872425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:39.955941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bc807-2bfc-42bf-802c-de0e32614ce2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:39.958167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df5bc807-2bfc-42bf-802c-de0e32614ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:39.962607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 650/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Aug 26 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:40.097262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bc807-2bfc-42bf-802c-de0e32614ce2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:40.197287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac48d-7768-4248-a7e9-af7e491d0db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:40.197937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac48d-7768-4248-a7e9-af7e491d0db9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:40.198224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac48d-7768-4248-a7e9-af7e491d0db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:40.198501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac48d-7768-4248-a7e9-af7e491d0db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:40.200128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-647ac48d-7768-4248-a7e9-af7e491d0db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:40.267431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:40.336435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ac48d-7768-4248-a7e9-af7e491d0db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:40.337945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ac48d-7768-4248-a7e9-af7e491d0db9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:40.382332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 661/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:31:42.629642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439060-ab34-4a52-b1bd-d192e6db4ae8 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:42.630257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439060-ab34-4a52-b1bd-d192e6db4ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:42.630354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439060-ab34-4a52-b1bd-d192e6db4ae8 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:42.631657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 651/1312] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:42.636850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd763c-b464-4d93-8559-35acf7565153 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:42.637302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd763c-b464-4d93-8559-35acf7565153 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:42.637533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd763c-b464-4d93-8559-35acf7565153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:42.735417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e5cd763c-b464-4d93-8559-35acf7565153 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:42.737795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5cd763c-b464-4d93-8559-35acf7565153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:42.844832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 662/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:43.151820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439060-ab34-4a52-b1bd-d192e6db4ae8 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:43.154150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-17439060-ab34-4a52-b1bd-d192e6db4ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:43.263600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439060-ab34-4a52-b1bd-d192e6db4ae8 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:43.335062 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:43.337973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7f070-5042-4e32-8788-22c4423fbf04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:43.338753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f070-5042-4e32-8788-22c4423fbf04 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:43.339206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f070-5042-4e32-8788-22c4423fbf04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:43.339519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f070-5042-4e32-8788-22c4423fbf04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:43.341358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4ea7f070-5042-4e32-8788-22c4423fbf04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:43.461974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7f070-5042-4e32-8788-22c4423fbf04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:43.463433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7f070-5042-4e32-8788-22c4423fbf04 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:43.482478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 652/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:45.704819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda95d63-8220-457b-8d0a-d149569f18f2 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:45.705393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda95d63-8220-457b-8d0a-d149569f18f2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:45.705393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda95d63-8220-457b-8d0a-d149569f18f2 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:45.706739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 663/1315] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:45.716149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e256-8890-4074-b9d5-96d930532d58 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:45.716660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e256-8890-4074-b9d5-96d930532d58 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:45.716758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529e256-8890-4074-b9d5-96d930532d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:45.787571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3529e256-8890-4074-b9d5-96d930532d58 None None] MFA Rules not processed for user `a0856d72f27148cd8898e10ae2f22155`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:45.788769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3529e256-8890-4074-b9d5-96d930532d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:45.839836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:45.885207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 653/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:46.177250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda95d63-8220-457b-8d0a-d149569f18f2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:46.178844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fda95d63-8220-457b-8d0a-d149569f18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:46.188367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:46.282070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda95d63-8220-457b-8d0a-d149569f18f2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:46.354507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fb700-798d-475b-b912-ffdcf5777744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:46.355121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb700-798d-475b-b912-ffdcf5777744 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:46.355401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb700-798d-475b-b912-ffdcf5777744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:46.355671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fb700-798d-475b-b912-ffdcf5777744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:46.357288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-664fb700-798d-475b-b912-ffdcf5777744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:46.421863 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:46.468168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fb700-798d-475b-b912-ffdcf5777744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:46.469605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fb700-798d-475b-b912-ffdcf5777744 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:46.488025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 664/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:48.980573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90472973-3d9c-4b4f-8bee-ac19abdc5c84 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:48.981212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90472973-3d9c-4b4f-8bee-ac19abdc5c84 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:48.981212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90472973-3d9c-4b4f-8bee-ac19abdc5c84 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:48.982544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 654/1318] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:48.988002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874822d-953a-4ad1-92e6-82f7d42aa98b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:48.988460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874822d-953a-4ad1-92e6-82f7d42aa98b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:48.988564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874822d-953a-4ad1-92e6-82f7d42aa98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:49.054311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f874822d-953a-4ad1-92e6-82f7d42aa98b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:49.055518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f874822d-953a-4ad1-92e6-82f7d42aa98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:49.151477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 665/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:49.455338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a292-57c3-404a-95cd-f6ffb8048db9 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:49.455619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a292-57c3-404a-95cd-f6ffb8048db9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:49.455900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5a292-57c3-404a-95cd-f6ffb8048db9 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:49.457232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 655/1320] 10.222.0.20 () {54 vars in 965 bytes} [Fri Aug 26 15:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:49.464018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eae99a-dfd7-471c-a615-6f95dac91edf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:49.464310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eae99a-dfd7-471c-a615-6f95dac91edf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:49.464591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eae99a-dfd7-471c-a615-6f95dac91edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:49.486517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:49.542403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-58eae99a-dfd7-471c-a615-6f95dac91edf None None] MFA Rules not processed for user `9962d812513a428b99ada1f79a5b88d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:49.543622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-58eae99a-dfd7-471c-a615-6f95dac91edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:49.618323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 666/1321] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Aug 26 15:31:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:49.627259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5a292-57c3-404a-95cd-f6ffb8048db9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:49.628869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2fb5a292-57c3-404a-95cd-f6ffb8048db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:49.731614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5a292-57c3-404a-95cd-f6ffb8048db9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:49.804187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a3d88-bbcb-4589-a430-27656fa3aac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:49.804787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a3d88-bbcb-4589-a430-27656fa3aac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:49.805070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a3d88-bbcb-4589-a430-27656fa3aac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:49.805345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a3d88-bbcb-4589-a430-27656fa3aac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:49.806981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-874a3d88-bbcb-4589-a430-27656fa3aac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:49.814291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:49.920812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a3d88-bbcb-4589-a430-27656fa3aac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:49.922302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a3d88-bbcb-4589-a430-27656fa3aac0 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:49.940198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 656/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:52.990345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72af60-e619-4ed6-a0ba-6fa704e88fb6 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:52.990892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72af60-e619-4ed6-a0ba-6fa704e88fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:52.990892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72af60-e619-4ed6-a0ba-6fa704e88fb6 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:52.992245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 667/1323] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:52.997573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302baf2c-20f3-4fc4-bf0e-0e4d519d7f76 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:52.998034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302baf2c-20f3-4fc4-bf0e-0e4d519d7f76 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:52.998173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302baf2c-20f3-4fc4-bf0e-0e4d519d7f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:53.064213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-302baf2c-20f3-4fc4-bf0e-0e4d519d7f76 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:53.065483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-302baf2c-20f3-4fc4-bf0e-0e4d519d7f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:53.127750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:53.169745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 657/1324] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:53.457402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72af60-e619-4ed6-a0ba-6fa704e88fb6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:53.459172 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8d72af60-e619-4ed6-a0ba-6fa704e88fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:53.565461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72af60-e619-4ed6-a0ba-6fa704e88fb6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:53.577691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:53.639611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206e738-6f4d-4269-835c-810b49cdb799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:53.640169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e738-6f4d-4269-835c-810b49cdb799 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:53.640448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e738-6f4d-4269-835c-810b49cdb799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:53.640717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e738-6f4d-4269-835c-810b49cdb799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:53.642354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b206e738-6f4d-4269-835c-810b49cdb799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:53.752116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206e738-6f4d-4269-835c-810b49cdb799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:53.753568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206e738-6f4d-4269-835c-810b49cdb799 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:53.772281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 668/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:55.814456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f593-a241-43f4-bb17-e033ec489c6a None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:55.814994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f593-a241-43f4-bb17-e033ec489c6a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:55.814994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f593-a241-43f4-bb17-e033ec489c6a None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:55.816286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 658/1326] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:55.822511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afad6e-6129-4395-a931-4ee751a17e2b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:55.822957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afad6e-6129-4395-a931-4ee751a17e2b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:55.823054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afad6e-6129-4395-a931-4ee751a17e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:55.872620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:55.891792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c5afad6e-6129-4395-a931-4ee751a17e2b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:55.893011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c5afad6e-6129-4395-a931-4ee751a17e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:55.990586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 669/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:56.275956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02f593-a241-43f4-bb17-e033ec489c6a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:56.277494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-dd02f593-a241-43f4-bb17-e033ec489c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:56.392713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02f593-a241-43f4-bb17-e033ec489c6a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:56.470008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b9305-bdc1-4c71-9f3f-b78fbb4341d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:56.470703 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9305-bdc1-4c71-9f3f-b78fbb4341d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:56.470979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9305-bdc1-4c71-9f3f-b78fbb4341d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:56.471246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9305-bdc1-4c71-9f3f-b78fbb4341d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:56.473044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f70b9305-bdc1-4c71-9f3f-b78fbb4341d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:56.493504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:56.587608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b9305-bdc1-4c71-9f3f-b78fbb4341d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:56.588977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b9305-bdc1-4c71-9f3f-b78fbb4341d0 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:56.608102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 659/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:58.590435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b491e-cc02-4048-b77e-72d4a1626617 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:58.591023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b491e-cc02-4048-b77e-72d4a1626617 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:58.591023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b491e-cc02-4048-b77e-72d4a1626617 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:58.592639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 670/1329] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:58.598865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e444d3-229e-40da-8a76-cccaa075ed58 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:58.599410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e444d3-229e-40da-8a76-cccaa075ed58 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:58.599733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e444d3-229e-40da-8a76-cccaa075ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:58.667471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-46e444d3-229e-40da-8a76-cccaa075ed58 None None] MFA Rules not processed for user `a0856d72f27148cd8898e10ae2f22155`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:58.668666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-46e444d3-229e-40da-8a76-cccaa075ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:58.732707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:58.765812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 660/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:59.069695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b491e-cc02-4048-b77e-72d4a1626617 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:59.071917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-124b491e-cc02-4048-b77e-72d4a1626617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:59.186550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b491e-cc02-4048-b77e-72d4a1626617 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:59.207266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:59.266809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461d70f-bba2-4322-9fd4-350b16bdee29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:59.266809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d70f-bba2-4322-9fd4-350b16bdee29 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:59.267122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d70f-bba2-4322-9fd4-350b16bdee29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:59.267122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d70f-bba2-4322-9fd4-350b16bdee29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:59.268765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2461d70f-bba2-4322-9fd4-350b16bdee29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:59.389864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461d70f-bba2-4322-9fd4-350b16bdee29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:59.391327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461d70f-bba2-4322-9fd4-350b16bdee29 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:59.414872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 671/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:01.581422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905eb45-b023-458e-a857-86631ba72af5 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:01.582030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905eb45-b023-458e-a857-86631ba72af5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:01.582030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905eb45-b023-458e-a857-86631ba72af5 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:01.584307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 661/1332] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:01.589462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724decb-27fa-4436-8160-bdc66f0d76c6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:01.589922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724decb-27fa-4436-8160-bdc66f0d76c6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:01.590068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724decb-27fa-4436-8160-bdc66f0d76c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:01.652479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:01.655205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1724decb-27fa-4436-8160-bdc66f0d76c6 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:01.657105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1724decb-27fa-4436-8160-bdc66f0d76c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:01.754019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 672/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:02.034845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905eb45-b023-458e-a857-86631ba72af5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:02.036953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a905eb45-b023-458e-a857-86631ba72af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:02.141745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905eb45-b023-458e-a857-86631ba72af5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:02.214370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18ec4a-58f2-485d-b3b0-ac0825496780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:02.214975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18ec4a-58f2-485d-b3b0-ac0825496780 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:02.215258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18ec4a-58f2-485d-b3b0-ac0825496780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:02.215531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18ec4a-58f2-485d-b3b0-ac0825496780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:02.217140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9b18ec4a-58f2-485d-b3b0-ac0825496780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:02.244250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:02.325943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18ec4a-58f2-485d-b3b0-ac0825496780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:02.327333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18ec4a-58f2-485d-b3b0-ac0825496780 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:02.345696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 662/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:04.354308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c3309-1411-42e5-9e05-0b48dd586355 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:04.354871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c3309-1411-42e5-9e05-0b48dd586355 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:04.354871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c3309-1411-42e5-9e05-0b48dd586355 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:04.356186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 673/1335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:04.361328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573127b-e3dc-4e88-b110-051499adfba7 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:04.361724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573127b-e3dc-4e88-b110-051499adfba7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:04.361915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573127b-e3dc-4e88-b110-051499adfba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:04.427519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e573127b-e3dc-4e88-b110-051499adfba7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:04.428653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e573127b-e3dc-4e88-b110-051499adfba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:04.503177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:04.527432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 663/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:04.811300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c3309-1411-42e5-9e05-0b48dd586355 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:04.812855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a45c3309-1411-42e5-9e05-0b48dd586355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:04.915564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c3309-1411-42e5-9e05-0b48dd586355 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:04.944231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:04.989638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca9555-d011-4bf5-b25b-d7209e9df901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:04.990275 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9555-d011-4bf5-b25b-d7209e9df901 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:04.990559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9555-d011-4bf5-b25b-d7209e9df901 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:04.990833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca9555-d011-4bf5-b25b-d7209e9df901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:04.992434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7bca9555-d011-4bf5-b25b-d7209e9df901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:05.099939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca9555-d011-4bf5-b25b-d7209e9df901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:05.101380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca9555-d011-4bf5-b25b-d7209e9df901 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:05.120374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 674/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:07.439574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748531d5-5ad2-41f0-b48f-1862d9e47994 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:07.440150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748531d5-5ad2-41f0-b48f-1862d9e47994 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:07.440150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748531d5-5ad2-41f0-b48f-1862d9e47994 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:07.441499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 664/1338] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:32:07.446733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b6f0-c469-4e07-b189-1f34cfcfc96c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:07.447126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b6f0-c469-4e07-b189-1f34cfcfc96c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:07.447283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b6f0-c469-4e07-b189-1f34cfcfc96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:07.516077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9ad2b6f0-c469-4e07-b189-1f34cfcfc96c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:07.517289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ad2b6f0-c469-4e07-b189-1f34cfcfc96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:07.526265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:07.615202 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 675/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:32:07.900543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748531d5-5ad2-41f0-b48f-1862d9e47994 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:07.902235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-748531d5-5ad2-41f0-b48f-1862d9e47994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:08.006398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748531d5-5ad2-41f0-b48f-1862d9e47994 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:08.078928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa47e4-bcf1-455a-872d-7a037abfb3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:08.079527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa47e4-bcf1-455a-872d-7a037abfb3db service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:08.079808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa47e4-bcf1-455a-872d-7a037abfb3db service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:08.080084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa47e4-bcf1-455a-872d-7a037abfb3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:08.081685 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-97aa47e4-bcf1-455a-872d-7a037abfb3db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:08.118507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:08.193323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa47e4-bcf1-455a-872d-7a037abfb3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:08.194721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa47e4-bcf1-455a-872d-7a037abfb3db service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:08.213497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 665/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:12.151327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da6ed-6b9e-4229-ba15-319646527a65 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:12.151897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da6ed-6b9e-4229-ba15-319646527a65 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:12.151897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da6ed-6b9e-4229-ba15-319646527a65 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:12.153229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 676/1341] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:12.158564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786517-6c27-4c21-b18f-adcfc907d399 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:12.158994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786517-6c27-4c21-b18f-adcfc907d399 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:12.159135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2786517-6c27-4c21-b18f-adcfc907d399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:12.226612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c2786517-6c27-4c21-b18f-adcfc907d399 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:12.227821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c2786517-6c27-4c21-b18f-adcfc907d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:12.316029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:12.328834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 666/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:12.621604 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00da6ed-6b9e-4229-ba15-319646527a65 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:12.623271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a00da6ed-6b9e-4229-ba15-319646527a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:12.731737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00da6ed-6b9e-4229-ba15-319646527a65 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:12.770855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:12.806128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf78e74-c70a-4952-995a-065f972b6ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:12.806736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf78e74-c70a-4952-995a-065f972b6ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:12.807017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf78e74-c70a-4952-995a-065f972b6ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:12.807287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf78e74-c70a-4952-995a-065f972b6ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:12.808887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-edf78e74-c70a-4952-995a-065f972b6ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:12.918228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf78e74-c70a-4952-995a-065f972b6ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:12.919624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf78e74-c70a-4952-995a-065f972b6ea4 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:12.938309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 677/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:15.508705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029b824-cb35-4627-a2f0-022900fb9e76 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:15.509265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029b824-cb35-4627-a2f0-022900fb9e76 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:15.509265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029b824-cb35-4627-a2f0-022900fb9e76 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:15.510928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 667/1344] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:32:15.516363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dba2f-3460-4670-813f-ca3e3ac63762 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:15.516850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dba2f-3460-4670-813f-ca3e3ac63762 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:15.517071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dba2f-3460-4670-813f-ca3e3ac63762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:15.588977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-286dba2f-3460-4670-813f-ca3e3ac63762 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:15.590834 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-286dba2f-3460-4670-813f-ca3e3ac63762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:15.610380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:15.691973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 678/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:32:15.978817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029b824-cb35-4627-a2f0-022900fb9e76 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:15.980389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1029b824-cb35-4627-a2f0-022900fb9e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:16.092541 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029b824-cb35-4627-a2f0-022900fb9e76 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:16.169358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a987b5-0736-45db-8f07-5be951a1eb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:16.170011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a987b5-0736-45db-8f07-5be951a1eb21 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:16.170297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a987b5-0736-45db-8f07-5be951a1eb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:16.170571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a987b5-0736-45db-8f07-5be951a1eb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:16.172281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e1a987b5-0736-45db-8f07-5be951a1eb21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:16.219189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:16.288851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a987b5-0736-45db-8f07-5be951a1eb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:16.290282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a987b5-0736-45db-8f07-5be951a1eb21 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:16.309512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 668/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:20.329037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dcba2-64cf-4224-b174-227f0802712d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:20.329539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dcba2-64cf-4224-b174-227f0802712d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:20.332111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dcba2-64cf-4224-b174-227f0802712d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:20.338877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 679/1347] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:20.339959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7289-2a19-44c6-892f-7b03fa05cc53 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:20.340402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7289-2a19-44c6-892f-7b03fa05cc53 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:20.340509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7289-2a19-44c6-892f-7b03fa05cc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:20.423267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-63ef7289-2a19-44c6-892f-7b03fa05cc53 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:20.424504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-63ef7289-2a19-44c6-892f-7b03fa05cc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:20.534227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:20.537546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 669/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:20.829296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dcba2-64cf-4224-b174-227f0802712d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:20.830874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-706dcba2-64cf-4224-b174-227f0802712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:20.940614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dcba2-64cf-4224-b174-227f0802712d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:20.991662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:21.019310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b8154-8038-4285-9cca-6de6c1e42e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:21.019892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b8154-8038-4285-9cca-6de6c1e42e86 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:21.020166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b8154-8038-4285-9cca-6de6c1e42e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:21.020433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b8154-8038-4285-9cca-6de6c1e42e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:21.022078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9b7b8154-8038-4285-9cca-6de6c1e42e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:21.140139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b8154-8038-4285-9cca-6de6c1e42e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:21.141587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b8154-8038-4285-9cca-6de6c1e42e86 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:21.160432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 680/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:26.068163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a985-cc35-4195-b0e6-5791c6b6369a None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:26.068647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a985-cc35-4195-b0e6-5791c6b6369a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:26.068730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998a985-cc35-4195-b0e6-5791c6b6369a None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:26.070157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 670/1350] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:26.075482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322324-d1c5-4e3c-9bbe-cafbd2a94554 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:26.076469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322324-d1c5-4e3c-9bbe-cafbd2a94554 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:26.076912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322324-d1c5-4e3c-9bbe-cafbd2a94554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:26.216184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14322324-d1c5-4e3c-9bbe-cafbd2a94554 None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:26.219106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14322324-d1c5-4e3c-9bbe-cafbd2a94554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:26.251868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:26.359762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 681/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:30.658968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1211-72df-408c-ad91-bec8ca2d10ed None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:30.661935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1211-72df-408c-ad91-bec8ca2d10ed None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:30.661935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1211-72df-408c-ad91-bec8ca2d10ed None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:30.662568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 671/1352] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:30.668387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d06e5-b92b-422a-a081-f56ae286718a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:30.668866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d06e5-b92b-422a-a081-f56ae286718a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:30.668984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d06e5-b92b-422a-a081-f56ae286718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:30.760449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e35d06e5-b92b-422a-a081-f56ae286718a None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:30.761663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e35d06e5-b92b-422a-a081-f56ae286718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:30.840663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:30.893855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 682/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:32:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:32.430038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7317-3dda-4603-8e32-7dc5b03f195c None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:32.430561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7317-3dda-4603-8e32-7dc5b03f195c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:32.430561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7317-3dda-4603-8e32-7dc5b03f195c None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:32.432122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 672/1354] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:32.436930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008385a4-0b27-48cf-8040-ba971585ce16 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:32.437400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008385a4-0b27-48cf-8040-ba971585ce16 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:32.437520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008385a4-0b27-48cf-8040-ba971585ce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:32.517985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-008385a4-0b27-48cf-8040-ba971585ce16 None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:32.519820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-008385a4-0b27-48cf-8040-ba971585ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:32.630213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 683/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:32:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:36.128796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7529-a190-463e-ba2b-b56a1cbfcd03 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:36.129254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7529-a190-463e-ba2b-b56a1cbfcd03 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:36.129365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7529-a190-463e-ba2b-b56a1cbfcd03 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:36.130711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 673/1356] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:36.136419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00539-6e1b-490e-bddb-d1d6cb937a06 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:36.136880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00539-6e1b-490e-bddb-d1d6cb937a06 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:36.136987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00539-6e1b-490e-bddb-d1d6cb937a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:36.181248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:36.225732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f8c00539-6e1b-490e-bddb-d1d6cb937a06 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:36.227088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f8c00539-6e1b-490e-bddb-d1d6cb937a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:36.346128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 684/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:36.650146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e3a3f-5a94-4453-85dc-9951cc401626 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:36.650846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e3a3f-5a94-4453-85dc-9951cc401626 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:36.651473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e3a3f-5a94-4453-85dc-9951cc401626 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:36.654129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 674/1358] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 26 15:32:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:36.662907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a728-c7d3-4a37-98c7-feaeb8c1842e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:36.663673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a728-c7d3-4a37-98c7-feaeb8c1842e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:36.664612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a728-c7d3-4a37-98c7-feaeb8c1842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:36.751168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e6f0a728-c7d3-4a37-98c7-feaeb8c1842e None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:36.752494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e6f0a728-c7d3-4a37-98c7-feaeb8c1842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:36.806423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:36.879246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 685/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 26 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:36.888171 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e3a3f-5a94-4453-85dc-9951cc401626 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:36.890185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a12e3a3f-5a94-4453-85dc-9951cc401626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:37.044492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e3a3f-5a94-4453-85dc-9951cc401626 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:37.139417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:37.179113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cacf5-b1c1-4679-87b9-60bc7e1ba1e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:37.180339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cacf5-b1c1-4679-87b9-60bc7e1ba1e9 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:37.181352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cacf5-b1c1-4679-87b9-60bc7e1ba1e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:37.182092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cacf5-b1c1-4679-87b9-60bc7e1ba1e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:37.183904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5f6cacf5-b1c1-4679-87b9-60bc7e1ba1e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:37.279572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cacf5-b1c1-4679-87b9-60bc7e1ba1e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:37.281172 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cacf5-b1c1-4679-87b9-60bc7e1ba1e9 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:37.299985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 675/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:39.521981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dee22-d812-4978-bad5-0f2a6f9a67a1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:39.522526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dee22-d812-4978-bad5-0f2a6f9a67a1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:39.522780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dee22-d812-4978-bad5-0f2a6f9a67a1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:39.529935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd0264-87b8-4dd4-ba02-74947e9ef1c3 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:39.530414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd0264-87b8-4dd4-ba02-74947e9ef1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:39.530700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd0264-87b8-4dd4-ba02-74947e9ef1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:39.535981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 686/1361] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:39.601952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-52fd0264-87b8-4dd4-ba02-74947e9ef1c3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:39.603308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-52fd0264-87b8-4dd4-ba02-74947e9ef1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:39.651592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:39.726300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 676/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:40.025589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dee22-d812-4978-bad5-0f2a6f9a67a1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:40.027390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b5dee22-d812-4978-bad5-0f2a6f9a67a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:40.189926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dee22-d812-4978-bad5-0f2a6f9a67a1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:40.200533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:40.322450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff480df9-a3b7-428c-9e89-2de800b20bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:40.323125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480df9-a3b7-428c-9e89-2de800b20bbb service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:40.323473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480df9-a3b7-428c-9e89-2de800b20bbb service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:40.323815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff480df9-a3b7-428c-9e89-2de800b20bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:40.325719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff480df9-a3b7-428c-9e89-2de800b20bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:40.431764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff480df9-a3b7-428c-9e89-2de800b20bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:40.433591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff480df9-a3b7-428c-9e89-2de800b20bbb service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:40.454049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 687/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:42.791357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11f16-825c-403c-8c05-830c71b8fc4b None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:42.791947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11f16-825c-403c-8c05-830c71b8fc4b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:42.791947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11f16-825c-403c-8c05-830c71b8fc4b None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:42.793256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 677/1364] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:32:42.798692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6702b5-97f2-4896-b9eb-4e7bf605a712 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:42.799133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6702b5-97f2-4896-b9eb-4e7bf605a712 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:42.799375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6702b5-97f2-4896-b9eb-4e7bf605a712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:42.817622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:42.875131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3a6702b5-97f2-4896-b9eb-4e7bf605a712 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:42.876495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3a6702b5-97f2-4896-b9eb-4e7bf605a712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:42.985393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 688/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:43.285353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d771-20d3-4add-9a1e-48f3b8895823 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:43.285978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d771-20d3-4add-9a1e-48f3b8895823 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:43.286357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d771-20d3-4add-9a1e-48f3b8895823 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:43.287980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 678/1366] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 26 15:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:43.293564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573e0fa-f760-406b-8904-87cf0be7e882 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:43.294087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573e0fa-f760-406b-8904-87cf0be7e882 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:43.294386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573e0fa-f760-406b-8904-87cf0be7e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:43.376995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9573e0fa-f760-406b-8904-87cf0be7e882 None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:43.378175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9573e0fa-f760-406b-8904-87cf0be7e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:43.426897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:43.521033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 689/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 26 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:43.529195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d771-20d3-4add-9a1e-48f3b8895823 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:43.530795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7d00d771-20d3-4add-9a1e-48f3b8895823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:43.685929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d771-20d3-4add-9a1e-48f3b8895823 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:43.708388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:43.812410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2fa1d-493d-4088-873f-11396c3a7fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:43.813078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fa1d-493d-4088-873f-11396c3a7fa5 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:43.813329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fa1d-493d-4088-873f-11396c3a7fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:43.813567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fa1d-493d-4088-873f-11396c3a7fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:43.815201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-42f2fa1d-493d-4088-873f-11396c3a7fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:43.913527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2fa1d-493d-4088-873f-11396c3a7fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:43.915973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2fa1d-493d-4088-873f-11396c3a7fa5 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:43.935411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 679/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:44.372128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c280-2107-473c-a752-78b67b0581ae None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:44.372672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c280-2107-473c-a752-78b67b0581ae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:44.372672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c280-2107-473c-a752-78b67b0581ae None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:44.374092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 690/1369] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:44.380001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515dd-c2c6-4509-ad1f-63fdbe14395a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:44.380293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515dd-c2c6-4509-ad1f-63fdbe14395a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:44.380575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c515dd-c2c6-4509-ad1f-63fdbe14395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:44.418062 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:44.465882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-34c515dd-c2c6-4509-ad1f-63fdbe14395a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:44.465882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-34c515dd-c2c6-4509-ad1f-63fdbe14395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:44.573904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 680/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:45.166521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74454111-5d42-440e-8312-29225548ff80 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:45.166877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74454111-5d42-440e-8312-29225548ff80 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:45.167214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74454111-5d42-440e-8312-29225548ff80 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:45.168812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 691/1371] 10.222.0.20 () {54 vars in 964 bytes} [Fri Aug 26 15:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:45.173680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7e15b-acab-4055-85d0-cf1fe7708e1a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:45.174181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7e15b-acab-4055-85d0-cf1fe7708e1a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:45.174282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7e15b-acab-4055-85d0-cf1fe7708e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:45.264228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e0d7e15b-acab-4055-85d0-cf1fe7708e1a None None] MFA Rules not processed for user `3adaa1462c8a4acdab7e631a795cd40f`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:45.265716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e0d7e15b-acab-4055-85d0-cf1fe7708e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:45.318452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:45.354783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 681/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Aug 26 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:45.363780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74454111-5d42-440e-8312-29225548ff80 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:45.365357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74454111-5d42-440e-8312-29225548ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:45.483356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74454111-5d42-440e-8312-29225548ff80 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:45.541605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:45.596107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc1610-f05d-4afe-9d7b-67945a791072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:45.597259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1610-f05d-4afe-9d7b-67945a791072 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:45.597659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1610-f05d-4afe-9d7b-67945a791072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:45.598004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc1610-f05d-4afe-9d7b-67945a791072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:45.599998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-08bc1610-f05d-4afe-9d7b-67945a791072 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:45.741413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1610-f05d-4afe-9d7b-67945a791072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:45.743061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc1610-f05d-4afe-9d7b-67945a791072 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:45.768594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 692/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:45.963503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59096083-44d9-4354-b627-209ad60d7e62 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:45.963796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59096083-44d9-4354-b627-209ad60d7e62 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:45.964077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59096083-44d9-4354-b627-209ad60d7e62 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:45.965462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 682/1374] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:45.970818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ca735-24b8-44ee-afb9-2937aa583918 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:45.971184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ca735-24b8-44ee-afb9-2937aa583918 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:45.971533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ca735-24b8-44ee-afb9-2937aa583918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:46.040904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3b5ca735-24b8-44ee-afb9-2937aa583918 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:46.042138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3b5ca735-24b8-44ee-afb9-2937aa583918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:46.063495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:46.147778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 693/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:46.439322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59096083-44d9-4354-b627-209ad60d7e62 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:46.441757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-59096083-44d9-4354-b627-209ad60d7e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:46.596611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59096083-44d9-4354-b627-209ad60d7e62 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:46.648478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:46.712025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53917749-a2eb-4216-bcd4-1158bc7961f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:46.712535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53917749-a2eb-4216-bcd4-1158bc7961f9 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:46.712818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53917749-a2eb-4216-bcd4-1158bc7961f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:46.713096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53917749-a2eb-4216-bcd4-1158bc7961f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:46.714753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-53917749-a2eb-4216-bcd4-1158bc7961f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:46.804470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53917749-a2eb-4216-bcd4-1158bc7961f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:46.806109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53917749-a2eb-4216-bcd4-1158bc7961f9 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:46.824581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 683/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:48.794083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6eb19-0790-4102-ac2a-6d23b028dcc8 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:48.794844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6eb19-0790-4102-ac2a-6d23b028dcc8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:48.794844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6eb19-0790-4102-ac2a-6d23b028dcc8 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:48.796206 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 694/1377] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:48.801809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b25189-9dbc-4143-bd22-545ab5475564 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:48.802323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b25189-9dbc-4143-bd22-545ab5475564 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:48.802508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b25189-9dbc-4143-bd22-545ab5475564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:48.881493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c3b25189-9dbc-4143-bd22-545ab5475564 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:48.882658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c3b25189-9dbc-4143-bd22-545ab5475564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:48.889228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:48.981400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 684/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:49.293769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6eb19-0790-4102-ac2a-6d23b028dcc8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:49.295522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2ab6eb19-0790-4102-ac2a-6d23b028dcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:49.477531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6eb19-0790-4102-ac2a-6d23b028dcc8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:49.481581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:49.604879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd542ee0-fbde-49d9-8857-fffba1223bfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:49.605482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542ee0-fbde-49d9-8857-fffba1223bfc service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:49.605763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542ee0-fbde-49d9-8857-fffba1223bfc service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:49.606065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542ee0-fbde-49d9-8857-fffba1223bfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:49.607659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fd542ee0-fbde-49d9-8857-fffba1223bfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:49.712784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542ee0-fbde-49d9-8857-fffba1223bfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:49.714434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542ee0-fbde-49d9-8857-fffba1223bfc service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:49.734283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 695/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:32:51.734706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822405-33f4-48ad-b9cf-721523276f04 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:51.735253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822405-33f4-48ad-b9cf-721523276f04 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:51.735253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53822405-33f4-48ad-b9cf-721523276f04 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:51.736715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 685/1380] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:51.742735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe8b56-a7dc-4267-8f17-332e4031db26 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:51.743179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe8b56-a7dc-4267-8f17-332e4031db26 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:51.743285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe8b56-a7dc-4267-8f17-332e4031db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:51.755259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:51.812532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b2fe8b56-a7dc-4267-8f17-332e4031db26 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:51.813737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2fe8b56-a7dc-4267-8f17-332e4031db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:51.919701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 696/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:52.217104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53822405-33f4-48ad-b9cf-721523276f04 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:52.218815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-53822405-33f4-48ad-b9cf-721523276f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:52.374455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:52.386251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53822405-33f4-48ad-b9cf-721523276f04 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:52.508044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae7dce-ee63-4ab6-a435-0aaf59c10d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:52.508668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae7dce-ee63-4ab6-a435-0aaf59c10d91 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:52.508933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae7dce-ee63-4ab6-a435-0aaf59c10d91 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:52.509225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae7dce-ee63-4ab6-a435-0aaf59c10d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:52.510904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-33ae7dce-ee63-4ab6-a435-0aaf59c10d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:52.607467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae7dce-ee63-4ab6-a435-0aaf59c10d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:52.609090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae7dce-ee63-4ab6-a435-0aaf59c10d91 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:52.621606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:52.631570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 686/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:54.644856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808457-504c-485c-b45d-3489cb30e80c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:54.645430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808457-504c-485c-b45d-3489cb30e80c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:54.645430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808457-504c-485c-b45d-3489cb30e80c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:54.646842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 697/1383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:54.653589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eb956-fa22-48d7-a6bb-3368d8cc2c59 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:54.654048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eb956-fa22-48d7-a6bb-3368d8cc2c59 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:54.654257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eb956-fa22-48d7-a6bb-3368d8cc2c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:54.730034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-122eb956-fa22-48d7-a6bb-3368d8cc2c59 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:54.731590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-122eb956-fa22-48d7-a6bb-3368d8cc2c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:54.840098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 687/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:55.194722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69808457-504c-485c-b45d-3489cb30e80c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:55.196684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-69808457-504c-485c-b45d-3489cb30e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:55.290863 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:55.365609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69808457-504c-485c-b45d-3489cb30e80c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:55.496267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8420-8d29-4bb1-b94f-d2c36dfdcdd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:55.496902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8420-8d29-4bb1-b94f-d2c36dfdcdd3 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:55.497200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8420-8d29-4bb1-b94f-d2c36dfdcdd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:55.497491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8420-8d29-4bb1-b94f-d2c36dfdcdd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:55.499222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d76b8420-8d29-4bb1-b94f-d2c36dfdcdd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:55.552189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:55.593394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b8420-8d29-4bb1-b94f-d2c36dfdcdd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:55.595069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b8420-8d29-4bb1-b94f-d2c36dfdcdd3 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:55.614573 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 698/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:57.617253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12c2d-6b7e-4860-87ad-35e96da6728b None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:57.617869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12c2d-6b7e-4860-87ad-35e96da6728b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:57.617997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12c2d-6b7e-4860-87ad-35e96da6728b None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:57.619268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 688/1386] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:57.624556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9c0e-e8aa-474f-a1a5-d548143389b3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:57.624986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9c0e-e8aa-474f-a1a5-d548143389b3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:57.625133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d9c0e-e8aa-474f-a1a5-d548143389b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:57.698677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-370d9c0e-e8aa-474f-a1a5-d548143389b3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:57.700120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-370d9c0e-e8aa-474f-a1a5-d548143389b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:57.805438 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 699/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:58.107463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f12c2d-6b7e-4860-87ad-35e96da6728b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:58.109132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-45f12c2d-6b7e-4860-87ad-35e96da6728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:58.195444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:58.268382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f12c2d-6b7e-4860-87ad-35e96da6728b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:58.390750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342770b-4309-46b4-9f19-9210a987fdb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:58.391378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342770b-4309-46b4-9f19-9210a987fdb0 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:58.391676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342770b-4309-46b4-9f19-9210a987fdb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:58.391962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342770b-4309-46b4-9f19-9210a987fdb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:58.393644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8342770b-4309-46b4-9f19-9210a987fdb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:58.433159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:58.488617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342770b-4309-46b4-9f19-9210a987fdb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:58.490268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342770b-4309-46b4-9f19-9210a987fdb0 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:58.510050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 689/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:00.620761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ce7b-d287-400c-9799-e5accf71e029 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:00.621455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ce7b-d287-400c-9799-e5accf71e029 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:00.621455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ce7b-d287-400c-9799-e5accf71e029 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:00.622713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 700/1389] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:00.628482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b2870-9e6e-4ca8-bca7-b911c06ecb26 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:00.629149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b2870-9e6e-4ca8-bca7-b911c06ecb26 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:00.629336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b2870-9e6e-4ca8-bca7-b911c06ecb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:00.696920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ab1b2870-9e6e-4ca8-bca7-b911c06ecb26 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:00.698185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ab1b2870-9e6e-4ca8-bca7-b911c06ecb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:00.796837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 690/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:01.095565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17ce7b-d287-400c-9799-e5accf71e029 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:01.097911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb17ce7b-d287-400c-9799-e5accf71e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:01.130278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:01.259221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17ce7b-d287-400c-9799-e5accf71e029 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:01.369051 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:01.384655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd27f9-b40b-4b35-8808-ebaf45b804a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:01.385269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd27f9-b40b-4b35-8808-ebaf45b804a4 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:01.385550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd27f9-b40b-4b35-8808-ebaf45b804a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:01.385823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd27f9-b40b-4b35-8808-ebaf45b804a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:01.387474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-98fd27f9-b40b-4b35-8808-ebaf45b804a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:01.483485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd27f9-b40b-4b35-8808-ebaf45b804a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:01.485386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd27f9-b40b-4b35-8808-ebaf45b804a4 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:01.507646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 701/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:03.578783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b489-28c1-4317-94fb-6e016a8c16a4 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:03.579371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b489-28c1-4317-94fb-6e016a8c16a4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:03.579371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b489-28c1-4317-94fb-6e016a8c16a4 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:03.580687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 691/1392] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:03.586358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525fed-bb68-426f-9590-ee84350b47a7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:03.586818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525fed-bb68-426f-9590-ee84350b47a7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:03.586929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525fed-bb68-426f-9590-ee84350b47a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:03.654061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-73525fed-bb68-426f-9590-ee84350b47a7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:03.655260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73525fed-bb68-426f-9590-ee84350b47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:03.715208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:03.755974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 702/1393] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:03.996648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a3b1-09a2-4cd8-a7db-4b7f23804809 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:03.996873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a3b1-09a2-4cd8-a7db-4b7f23804809 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:03.997119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a3b1-09a2-4cd8-a7db-4b7f23804809 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:03.998557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 692/1394] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:04.004449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e602f-d284-453c-bba2-461d3f625bfd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:04.004736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e602f-d284-453c-bba2-461d3f625bfd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:04.005009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e602f-d284-453c-bba2-461d3f625bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:04.054311 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a3b1-09a2-4cd8-a7db-4b7f23804809 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:04.055879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7302a3b1-09a2-4cd8-a7db-4b7f23804809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:04.069365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:04.072504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9a0e602f-d284-453c-bba2-461d3f625bfd None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:04.073724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a0e602f-d284-453c-bba2-461d3f625bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:04.179139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 703/1395] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:04.207519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a3b1-09a2-4cd8-a7db-4b7f23804809 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:04.296250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:04.324054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e88554-fe38-428a-8a8f-1482169b60c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:04.324660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e88554-fe38-428a-8a8f-1482169b60c6 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:04.324946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e88554-fe38-428a-8a8f-1482169b60c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:04.325218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e88554-fe38-428a-8a8f-1482169b60c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:04.326861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a4e88554-fe38-428a-8a8f-1482169b60c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:04.418321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e88554-fe38-428a-8a8f-1482169b60c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:04.419933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e88554-fe38-428a-8a8f-1482169b60c6 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:04.438406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 693/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:33:04.489719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10495f-6bd4-4504-b84c-68a7b16e513d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:04.490030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10495f-6bd4-4504-b84c-68a7b16e513d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:04.490303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10495f-6bd4-4504-b84c-68a7b16e513d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:04.491946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 704/1397] 10.222.0.20 () {54 vars in 967 bytes} [Fri Aug 26 15:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:33:04.497400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0804-0cd2-46dc-8470-c846bb6de525 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:04.497863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0804-0cd2-46dc-8470-c846bb6de525 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:04.498165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0804-0cd2-46dc-8470-c846bb6de525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:04.594106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-f4ee0804-0cd2-46dc-8470-c846bb6de525 None None] MFA Rules not processed for user `a0c16885de9e4e82bcbede361e548ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:04.595362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f4ee0804-0cd2-46dc-8470-c846bb6de525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:04.641337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:04.679734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 694/1398] 10.222.0.20 () {58 vars in 1064 bytes} [Fri Aug 26 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:04.687204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10495f-6bd4-4504-b84c-68a7b16e513d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:04.688856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-de10495f-6bd4-4504-b84c-68a7b16e513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:04.739299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:04.795095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10495f-6bd4-4504-b84c-68a7b16e513d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:04.870418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7f454-0479-4e49-ba35-7f536a2cefde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c16885de9e4e82bcbede361e548ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:04.870937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7f454-0479-4e49-ba35-7f536a2cefde service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:04.871213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7f454-0479-4e49-ba35-7f536a2cefde service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:04.871479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7f454-0479-4e49-ba35-7f536a2cefde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:04.873049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cdc7f454-0479-4e49-ba35-7f536a2cefde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:04.966288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:04.983130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7f454-0479-4e49-ba35-7f536a2cefde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:04.984564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7f454-0479-4e49-ba35-7f536a2cefde service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:05.005009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 705/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:05.748618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177238-860b-4a35-844e-9a1c8a923d24 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:05.749087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177238-860b-4a35-844e-9a1c8a923d24 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:05.749295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177238-860b-4a35-844e-9a1c8a923d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:05.818443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-51177238-860b-4a35-844e-9a1c8a923d24 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:05.819665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-51177238-860b-4a35-844e-9a1c8a923d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:05.913942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 695/1400] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:05.959995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53abdd-53dc-4e5e-b939-2507e1124f61 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:05.960551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53abdd-53dc-4e5e-b939-2507e1124f61 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:05.960551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53abdd-53dc-4e5e-b939-2507e1124f61 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:05.961994 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 706/1401] 10.222.0.20 () {54 vars in 943 bytes} [Fri Aug 26 15:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:05.968596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480871-6b33-4d7e-8582-759fcdcb707c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:05.968981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480871-6b33-4d7e-8582-759fcdcb707c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:05.969268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0480871-6b33-4d7e-8582-759fcdcb707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:06.040693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:06.048537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-a0480871-6b33-4d7e-8582-759fcdcb707c None None] MFA Rules not processed for user `36a184d53f1e4ebaaf55beee0f889bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:06.049755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a0480871-6b33-4d7e-8582-759fcdcb707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:06.160060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 696/1402] 10.222.0.20 () {58 vars in 1040 bytes} [Fri Aug 26 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:06.169584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53abdd-53dc-4e5e-b939-2507e1124f61 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:06.171284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8e53abdd-53dc-4e5e-b939-2507e1124f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:06.314505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53abdd-53dc-4e5e-b939-2507e1124f61 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:06.379466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:06.409357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3a291-4250-4ce2-967e-0b94a11f6d47 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:06.409664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3a291-4250-4ce2-967e-0b94a11f6d47 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:06.409940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3a291-4250-4ce2-967e-0b94a11f6d47 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:06.411287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 697/1403] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:06.416419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23a71-2453-43b7-b990-d2821760e775 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:06.416709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23a71-2453-43b7-b990-d2821760e775 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:06.416990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23a71-2453-43b7-b990-d2821760e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:06.423418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:06.424029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:06.424308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:06.425119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:06.426879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:06.488007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-83b23a71-2453-43b7-b990-d2821760e775 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:06.489299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-83b23a71-2453-43b7-b990-d2821760e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:06.542491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:06.544216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:06.554870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 707/1404] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:33:06.560784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:06.600248 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 698/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:33:06.898798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:06.899998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:07.017442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39eb41-764b-4d68-9456-4df7f8e20c8c service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:07.023693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:07.150786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7ccd3-b696-422a-a525-fd47aea8b125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:07.151317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ccd3-b696-422a-a525-fd47aea8b125 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:07.151596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ccd3-b696-422a-a525-fd47aea8b125 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:07.151869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ccd3-b696-422a-a525-fd47aea8b125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:07.153480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8de7ccd3-b696-422a-a525-fd47aea8b125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:07.255284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7ccd3-b696-422a-a525-fd47aea8b125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:07.256996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7ccd3-b696-422a-a525-fd47aea8b125 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:07.278650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 708/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:09.330419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba14544-bb1e-400e-9955-48139b503ef9 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:09.331982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba14544-bb1e-400e-9955-48139b503ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:09.332370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba14544-bb1e-400e-9955-48139b503ef9 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:09.337748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 699/1407] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:33:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:09.339344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5e70-a071-4c9a-b256-acaf59632530 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:09.339773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5e70-a071-4c9a-b256-acaf59632530 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:09.340230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5e70-a071-4c9a-b256-acaf59632530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:09.367977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:09.419970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fb7f5e70-a071-4c9a-b256-acaf59632530 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:09.421133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb7f5e70-a071-4c9a-b256-acaf59632530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:09.546682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 709/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:09.861164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba14544-bb1e-400e-9955-48139b503ef9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:09.863689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-aba14544-bb1e-400e-9955-48139b503ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:10.025009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba14544-bb1e-400e-9955-48139b503ef9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:10.079448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:10.158558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde43a6-6bb7-4265-8286-c387d2162980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:10.159567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde43a6-6bb7-4265-8286-c387d2162980 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:10.159847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde43a6-6bb7-4265-8286-c387d2162980 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:10.160151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde43a6-6bb7-4265-8286-c387d2162980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:10.161788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-abde43a6-6bb7-4265-8286-c387d2162980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:10.264262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde43a6-6bb7-4265-8286-c387d2162980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:10.266210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde43a6-6bb7-4265-8286-c387d2162980 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:10.291780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 700/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:19.544530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=58 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:20.288762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=76 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:28.936251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dec58-1990-4177-84f5-35997e158faf None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:28.936851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dec58-1990-4177-84f5-35997e158faf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:28.936851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dec58-1990-4177-84f5-35997e158faf None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:28.938186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 710/1410] 10.222.0.20 () {54 vars in 918 bytes} [Fri Aug 26 15:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:28.944293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021937-ed7f-4958-8d13-e89079474701 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:28.944718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021937-ed7f-4958-8d13-e89079474701 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:28.944874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86021937-ed7f-4958-8d13-e89079474701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:29.021765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-86021937-ed7f-4958-8d13-e89079474701 None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:29.023022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-86021937-ed7f-4958-8d13-e89079474701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:29.129342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 701/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 26 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:29.143807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32984de-f56a-4037-bee4-201ef1dca95a None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:29.144095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32984de-f56a-4037-bee4-201ef1dca95a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:29.144373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32984de-f56a-4037-bee4-201ef1dca95a None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:29.145709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 711/1412] 10.222.0.20 () {54 vars in 918 bytes} [Fri Aug 26 15:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:29.150466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb734-95f5-4839-a0bc-6f6d24cdefc2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:29.150737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb734-95f5-4839-a0bc-6f6d24cdefc2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:29.151018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb734-95f5-4839-a0bc-6f6d24cdefc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:29.223425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:29.226164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-a22cb734-95f5-4839-a0bc-6f6d24cdefc2 None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:29.227888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a22cb734-95f5-4839-a0bc-6f6d24cdefc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:29.345552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 702/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 26 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:31.757001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fa38-d218-48d7-a7a5-cb5544b101c9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:31.757559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fa38-d218-48d7-a7a5-cb5544b101c9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:31.757559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55fa38-d218-48d7-a7a5-cb5544b101c9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:31.758893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:31.764743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21362-c6a0-4002-8c36-d5f14a7b15ec None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:31.765171 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21362-c6a0-4002-8c36-d5f14a7b15ec None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:31.765298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21362-c6a0-4002-8c36-d5f14a7b15ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:31.832667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-0be21362-c6a0-4002-8c36-d5f14a7b15ec None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:31.833910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0be21362-c6a0-4002-8c36-d5f14a7b15ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:31.889830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:31.933387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:32.273929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55fa38-d218-48d7-a7a5-cb5544b101c9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:32.275359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3a55fa38-d218-48d7-a7a5-cb5544b101c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:32.477666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55fa38-d218-48d7-a7a5-cb5544b101c9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:32.560999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:32.605261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf16f0c-711c-4a50-9516-0d035a909ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:32.605900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf16f0c-711c-4a50-9516-0d035a909ce5 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:32.606185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf16f0c-711c-4a50-9516-0d035a909ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:32.606458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf16f0c-711c-4a50-9516-0d035a909ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:32.608102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2cf16f0c-711c-4a50-9516-0d035a909ce5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:32.707947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf16f0c-711c-4a50-9516-0d035a909ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:32.709791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf16f0c-711c-4a50-9516-0d035a909ce5 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:32.732453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 713/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:33.636756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca298f-72c8-42bc-a259-fdd88a5ff925 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:33.637300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca298f-72c8-42bc-a259-fdd88a5ff925 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:33.637300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca298f-72c8-42bc-a259-fdd88a5ff925 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:33.638686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:33.644085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c57f5-a5fc-4834-9e28-2a19a5e4e19a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:33.644542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c57f5-a5fc-4834-9e28-2a19a5e4e19a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:33.644648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c57f5-a5fc-4834-9e28-2a19a5e4e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:33.719880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2a4c57f5-a5fc-4834-9e28-2a19a5e4e19a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:33.721929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2a4c57f5-a5fc-4834-9e28-2a19a5e4e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:33.752736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:33.822168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:33.973392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca298f-72c8-42bc-a259-fdd88a5ff925 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:33.974875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-22ca298f-72c8-42bc-a259-fdd88a5ff925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:34.124695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca298f-72c8-42bc-a259-fdd88a5ff925 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:34.167500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:34.241088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebf796-d620-4ed5-8bb1-427ccadfde91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:34.241616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf796-d620-4ed5-8bb1-427ccadfde91 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:34.241933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf796-d620-4ed5-8bb1-427ccadfde91 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:34.242210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebf796-d620-4ed5-8bb1-427ccadfde91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:34.243827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d6ebf796-d620-4ed5-8bb1-427ccadfde91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:34.333909 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebf796-d620-4ed5-8bb1-427ccadfde91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:34.335525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebf796-d620-4ed5-8bb1-427ccadfde91 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:34.353338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 705/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:35.250612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46482f5-62b1-4958-889f-f018f2bd818e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:35.251192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46482f5-62b1-4958-889f-f018f2bd818e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:35.251192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46482f5-62b1-4958-889f-f018f2bd818e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:35.252693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:35.257727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a9f8-f987-4a30-9fbd-7f8259747160 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:35.258205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a9f8-f987-4a30-9fbd-7f8259747160 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:35.258315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a9f8-f987-4a30-9fbd-7f8259747160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:35.313568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:35.337323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-5ba5a9f8-f987-4a30-9fbd-7f8259747160 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:35.338564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5ba5a9f8-f987-4a30-9fbd-7f8259747160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:35.433232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:35.587099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46482f5-62b1-4958-889f-f018f2bd818e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:35.590883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e46482f5-62b1-4958-889f-f018f2bd818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:35.734981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46482f5-62b1-4958-889f-f018f2bd818e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:35.748191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:35.847575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af388b3-632a-45d5-9171-145ffe3d63e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:35.848188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af388b3-632a-45d5-9171-145ffe3d63e9 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:35.848466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af388b3-632a-45d5-9171-145ffe3d63e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:35.848737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af388b3-632a-45d5-9171-145ffe3d63e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:35.850394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0af388b3-632a-45d5-9171-145ffe3d63e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:35.944582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af388b3-632a-45d5-9171-145ffe3d63e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:35.946253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af388b3-632a-45d5-9171-145ffe3d63e9 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:35.963930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 716/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:36.831236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050852-7b46-4681-8e7b-dc75d704b90f None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:36.831835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050852-7b46-4681-8e7b-dc75d704b90f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:36.831835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050852-7b46-4681-8e7b-dc75d704b90f None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:36.833157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:36.838187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8aee-1e21-47d9-900e-d7cc957ab6e4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:36.838615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8aee-1e21-47d9-900e-d7cc957ab6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:36.838745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e8aee-1e21-47d9-900e-d7cc957ab6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:36.859166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:36.916272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-209e8aee-1e21-47d9-900e-d7cc957ab6e4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:36.917492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-209e8aee-1e21-47d9-900e-d7cc957ab6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:37.025582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:37.178734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050852-7b46-4681-8e7b-dc75d704b90f None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:37.180275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-50050852-7b46-4681-8e7b-dc75d704b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:37.290246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:37.328270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050852-7b46-4681-8e7b-dc75d704b90f None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:37.441678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748853d-f530-4fc5-8fad-d769a898547c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:37.442240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748853d-f530-4fc5-8fad-d769a898547c service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:37.442520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748853d-f530-4fc5-8fad-d769a898547c service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:37.442794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748853d-f530-4fc5-8fad-d769a898547c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:37.444412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6748853d-f530-4fc5-8fad-d769a898547c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:37.527050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:37.541829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748853d-f530-4fc5-8fad-d769a898547c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:37.543490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748853d-f530-4fc5-8fad-d769a898547c service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:37.561886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 708/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:38.446065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989e81-19ca-4615-9d96-51f5a623e2bf None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:38.446612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989e81-19ca-4615-9d96-51f5a623e2bf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:38.446612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c989e81-19ca-4615-9d96-51f5a623e2bf None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:38.447881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:38.452917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5817-556f-487b-b7e0-25b9cd460bbd None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:38.453331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5817-556f-487b-b7e0-25b9cd460bbd None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:38.453499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5817-556f-487b-b7e0-25b9cd460bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:38.530967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-583e5817-556f-487b-b7e0-25b9cd460bbd None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:38.532180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-583e5817-556f-487b-b7e0-25b9cd460bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:38.628783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:38.784725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c989e81-19ca-4615-9d96-51f5a623e2bf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:38.786201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c989e81-19ca-4615-9d96-51f5a623e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:38.871280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:38.933959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c989e81-19ca-4615-9d96-51f5a623e2bf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:39.047114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfdadc-2520-48db-8534-70ebe11256e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:39.047629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfdadc-2520-48db-8534-70ebe11256e0 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:39.047906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfdadc-2520-48db-8534-70ebe11256e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:39.048170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfdadc-2520-48db-8534-70ebe11256e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:39.050757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-36dfdadc-2520-48db-8534-70ebe11256e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:39.098724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:39.141392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfdadc-2520-48db-8534-70ebe11256e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:39.143778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfdadc-2520-48db-8534-70ebe11256e0 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:39.162484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 719/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:39.962728 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368e2ec-bce0-48d2-b843-81af4cc495d9 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:39.963345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368e2ec-bce0-48d2-b843-81af4cc495d9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:39.963345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368e2ec-bce0-48d2-b843-81af4cc495d9 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:39.964622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:39.969661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c288e-75ec-4c1f-a235-56820fb461da None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:39.970117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c288e-75ec-4c1f-a235-56820fb461da None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:39.970248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c288e-75ec-4c1f-a235-56820fb461da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:40.046453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-381c288e-75ec-4c1f-a235-56820fb461da None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:40.047651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-381c288e-75ec-4c1f-a235-56820fb461da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:40.144900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:40.295912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368e2ec-bce0-48d2-b843-81af4cc495d9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:40.297382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3368e2ec-bce0-48d2-b843-81af4cc495d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:40.344780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:40.440699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368e2ec-bce0-48d2-b843-81af4cc495d9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:40.555026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45d630-8788-429d-aa7f-9678214d6552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:40.555540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d630-8788-429d-aa7f-9678214d6552 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:40.555821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d630-8788-429d-aa7f-9678214d6552 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:40.556098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d630-8788-429d-aa7f-9678214d6552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:40.557722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2c45d630-8788-429d-aa7f-9678214d6552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:40.577199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:40.663229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d630-8788-429d-aa7f-9678214d6552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:40.664856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d630-8788-429d-aa7f-9678214d6552 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:40.683352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 711/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:41.492259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94398-37be-467a-b9c2-2dbbe1412549 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:41.492811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94398-37be-467a-b9c2-2dbbe1412549 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:41.492811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94398-37be-467a-b9c2-2dbbe1412549 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:41.494185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:41.499131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a316-2fac-4d19-82a9-e7d1d8639c6d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:41.499587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a316-2fac-4d19-82a9-e7d1d8639c6d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:41.499690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a316-2fac-4d19-82a9-e7d1d8639c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:41.577114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-7e05a316-2fac-4d19-82a9-e7d1d8639c6d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:41.578405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7e05a316-2fac-4d19-82a9-e7d1d8639c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:41.646333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:41.675857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:41.828459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94398-37be-467a-b9c2-2dbbe1412549 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:41.830531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bcf94398-37be-467a-b9c2-2dbbe1412549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:41.848635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:41.980889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94398-37be-467a-b9c2-2dbbe1412549 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:42.068086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:42.094067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9d602-5514-4726-a1f7-98f7e192ba5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:42.094606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9d602-5514-4726-a1f7-98f7e192ba5c service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:42.094889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9d602-5514-4726-a1f7-98f7e192ba5c service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:42.095163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9d602-5514-4726-a1f7-98f7e192ba5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:42.097080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-29e9d602-5514-4726-a1f7-98f7e192ba5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:42.190651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9d602-5514-4726-a1f7-98f7e192ba5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:42.192273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9d602-5514-4726-a1f7-98f7e192ba5c service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:42.209999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 722/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:43.033667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f741-9ecc-4193-b664-acf9e388a1f2 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:43.034307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f741-9ecc-4193-b664-acf9e388a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:43.034307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f741-9ecc-4193-b664-acf9e388a1f2 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:43.035707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:43.040540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd675be1-406f-415e-9aca-8ad28b8244fb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:43.040982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd675be1-406f-415e-9aca-8ad28b8244fb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:43.041086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd675be1-406f-415e-9aca-8ad28b8244fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:43.116809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dd675be1-406f-415e-9aca-8ad28b8244fb None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:43.118055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dd675be1-406f-415e-9aca-8ad28b8244fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:43.162685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:43.221865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:43.373953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f741-9ecc-4193-b664-acf9e388a1f2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:43.375489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4925f741-9ecc-4193-b664-acf9e388a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:43.522170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f741-9ecc-4193-b664-acf9e388a1f2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:43.576136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:43.635570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71963-eb85-4c1a-b0d4-175bf047e8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:43.636105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71963-eb85-4c1a-b0d4-175bf047e8e0 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:43.636387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71963-eb85-4c1a-b0d4-175bf047e8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:43.636660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71963-eb85-4c1a-b0d4-175bf047e8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:43.638304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7cd71963-eb85-4c1a-b0d4-175bf047e8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:43.726253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71963-eb85-4c1a-b0d4-175bf047e8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:43.727866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71963-eb85-4c1a-b0d4-175bf047e8e0 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:43.745897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 714/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:44.548303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb309-737e-471c-af53-da12a51e5cbd None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:44.551053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb309-737e-471c-af53-da12a51e5cbd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:44.551053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb309-737e-471c-af53-da12a51e5cbd None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:44.551053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:44.556035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e876-9987-4a97-8fa5-44900a5cc272 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:44.556548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e876-9987-4a97-8fa5-44900a5cc272 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:44.556972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e876-9987-4a97-8fa5-44900a5cc272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:44.643276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-5db1e876-9987-4a97-8fa5-44900a5cc272 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:44.644485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5db1e876-9987-4a97-8fa5-44900a5cc272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:44.646549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:44.741507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:44.895416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb309-737e-471c-af53-da12a51e5cbd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:44.896967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eebbb309-737e-471c-af53-da12a51e5cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:45.043838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb309-737e-471c-af53-da12a51e5cbd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:45.070239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:45.164640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fc25a-8053-4fd3-bacc-cb6a7c02953a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:45.165250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc25a-8053-4fd3-bacc-cb6a7c02953a service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:45.165526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc25a-8053-4fd3-bacc-cb6a7c02953a service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:45.165791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc25a-8053-4fd3-bacc-cb6a7c02953a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:45.167437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-386fc25a-8053-4fd3-bacc-cb6a7c02953a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:45.257523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc25a-8053-4fd3-bacc-cb6a7c02953a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:45.259171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc25a-8053-4fd3-bacc-cb6a7c02953a service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:45.277210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 725/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:47.121772 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e26e3-935d-4b64-bec7-53ef343786e1 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:47.122351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e26e3-935d-4b64-bec7-53ef343786e1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:47.122351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e26e3-935d-4b64-bec7-53ef343786e1 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:47.123754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:47.129579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742442d0-3599-4e84-b31a-5e656a84ef51 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:47.130074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742442d0-3599-4e84-b31a-5e656a84ef51 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:47.130230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742442d0-3599-4e84-b31a-5e656a84ef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:47.171829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:47.197348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-742442d0-3599-4e84-b31a-5e656a84ef51 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:47.198593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-742442d0-3599-4e84-b31a-5e656a84ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:47.295761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:47.593994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e26e3-935d-4b64-bec7-53ef343786e1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:47.596106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2f1e26e3-935d-4b64-bec7-53ef343786e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:47.698214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e26e3-935d-4b64-bec7-53ef343786e1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:47.730234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:47.771459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39f1c-0e6e-4df1-87a9-ff3d04c71beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:47.772066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39f1c-0e6e-4df1-87a9-ff3d04c71beb service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:47.772347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39f1c-0e6e-4df1-87a9-ff3d04c71beb service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:47.772623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39f1c-0e6e-4df1-87a9-ff3d04c71beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:47.774279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0bc39f1c-0e6e-4df1-87a9-ff3d04c71beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:47.882319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39f1c-0e6e-4df1-87a9-ff3d04c71beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:47.884474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39f1c-0e6e-4df1-87a9-ff3d04c71beb service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:47.905554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 717/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:49.983653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1e61d-f6e4-49fd-9c65-093a893ed60d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:49.984347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1e61d-f6e4-49fd-9c65-093a893ed60d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:49.984347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1e61d-f6e4-49fd-9c65-093a893ed60d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:49.985600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:49.992608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bad9-ee0d-4efa-8db1-e6740fdea0b9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:49.993063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bad9-ee0d-4efa-8db1-e6740fdea0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:49.993173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4bad9-ee0d-4efa-8db1-e6740fdea0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:50.059047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4af4bad9-ee0d-4efa-8db1-e6740fdea0b9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:50.060253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4af4bad9-ee0d-4efa-8db1-e6740fdea0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:50.073362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:50.158657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:50.453772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1e61d-f6e4-49fd-9c65-093a893ed60d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:50.456491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-88b1e61d-f6e4-49fd-9c65-093a893ed60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:50.563210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1e61d-f6e4-49fd-9c65-093a893ed60d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:50.575338 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:50.638682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb116aa-c6fe-49c7-95ef-8c6953c6757f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:50.639296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb116aa-c6fe-49c7-95ef-8c6953c6757f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:50.639576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb116aa-c6fe-49c7-95ef-8c6953c6757f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:50.639849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb116aa-c6fe-49c7-95ef-8c6953c6757f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:50.641520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-abb116aa-c6fe-49c7-95ef-8c6953c6757f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:50.749933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb116aa-c6fe-49c7-95ef-8c6953c6757f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:50.751300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb116aa-c6fe-49c7-95ef-8c6953c6757f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:50.770039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 728/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:53.007360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785303c1-9f66-45f8-a7df-0d5dcb4887df None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:53.007944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785303c1-9f66-45f8-a7df-0d5dcb4887df None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:53.007944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785303c1-9f66-45f8-a7df-0d5dcb4887df None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:53.009251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:53.015038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d458f2-c6f1-439b-acca-4218564cfd72 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:53.015497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d458f2-c6f1-439b-acca-4218564cfd72 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:53.015612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d458f2-c6f1-439b-acca-4218564cfd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:53.063143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:53.081436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b1d458f2-c6f1-439b-acca-4218564cfd72 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:53.082680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b1d458f2-c6f1-439b-acca-4218564cfd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:53.179120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:53.470899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785303c1-9f66-45f8-a7df-0d5dcb4887df None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:53.472506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-785303c1-9f66-45f8-a7df-0d5dcb4887df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:53.576416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785303c1-9f66-45f8-a7df-0d5dcb4887df None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:53.616587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:53.653637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63b5df-b10d-4445-962b-cfbf0d61957a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:53.654257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b5df-b10d-4445-962b-cfbf0d61957a service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:53.654542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b5df-b10d-4445-962b-cfbf0d61957a service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:53.654818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b5df-b10d-4445-962b-cfbf0d61957a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:53.656443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6a63b5df-b10d-4445-962b-cfbf0d61957a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:53.764723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63b5df-b10d-4445-962b-cfbf0d61957a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:53.766128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63b5df-b10d-4445-962b-cfbf0d61957a service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:53.785123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 720/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:55.852237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1899a-175a-43f1-82f1-9a7b7a309dfd None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:55.852825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1899a-175a-43f1-82f1-9a7b7a309dfd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:55.852825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1899a-175a-43f1-82f1-9a7b7a309dfd None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:55.854209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:55.859589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eead71-8ce8-4c1c-9fc9-ff22ef854c29 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:55.860000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eead71-8ce8-4c1c-9fc9-ff22ef854c29 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:55.860143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eead71-8ce8-4c1c-9fc9-ff22ef854c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:55.927735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b8eead71-8ce8-4c1c-9fc9-ff22ef854c29 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:55.928933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b8eead71-8ce8-4c1c-9fc9-ff22ef854c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:55.949256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:56.031253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:56.318157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1899a-175a-43f1-82f1-9a7b7a309dfd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:56.319778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bfc1899a-175a-43f1-82f1-9a7b7a309dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:56.423487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1899a-175a-43f1-82f1-9a7b7a309dfd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:56.443594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:56.498586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d244d77-5b56-42e0-b67a-29d8a6bb9323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:56.499193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d244d77-5b56-42e0-b67a-29d8a6bb9323 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:56.499471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d244d77-5b56-42e0-b67a-29d8a6bb9323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:56.499738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d244d77-5b56-42e0-b67a-29d8a6bb9323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:56.502020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9d244d77-5b56-42e0-b67a-29d8a6bb9323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:56.614529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d244d77-5b56-42e0-b67a-29d8a6bb9323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:56.615981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d244d77-5b56-42e0-b67a-29d8a6bb9323 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:56.634180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 731/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:58.622622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d2f8-9168-4666-82be-715842588843 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:58.623229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d2f8-9168-4666-82be-715842588843 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:58.623229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2d2f8-9168-4666-82be-715842588843 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:58.624541 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:58.630567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef3b5-0b66-437b-a6f5-0813e263abc9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:58.631003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef3b5-0b66-437b-a6f5-0813e263abc9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:58.631124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef3b5-0b66-437b-a6f5-0813e263abc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:58.701389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:58.704130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-07bef3b5-0b66-437b-a6f5-0813e263abc9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:58.706048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-07bef3b5-0b66-437b-a6f5-0813e263abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:58.802680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:59.092441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2d2f8-9168-4666-82be-715842588843 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:59.094039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c0c2d2f8-9168-4666-82be-715842588843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:59.201080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2d2f8-9168-4666-82be-715842588843 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:59.249818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:59.275700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38828-424b-4c26-9e02-8b6809d1821c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:59.276303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38828-424b-4c26-9e02-8b6809d1821c service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:59.276581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38828-424b-4c26-9e02-8b6809d1821c service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:59.276856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38828-424b-4c26-9e02-8b6809d1821c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:59.278495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-27d38828-424b-4c26-9e02-8b6809d1821c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:59.386075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38828-424b-4c26-9e02-8b6809d1821c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:59.387529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38828-424b-4c26-9e02-8b6809d1821c service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:59.405340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 723/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:34:01.406461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9822-5a54-4d21-b777-3058a3b900d3 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:01.407004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9822-5a54-4d21-b777-3058a3b900d3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:01.407004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9822-5a54-4d21-b777-3058a3b900d3 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:01.409248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:01.414584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abab5e-8efd-4ac1-af73-770ee5caf200 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:01.414999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abab5e-8efd-4ac1-af73-770ee5caf200 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:01.415210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abab5e-8efd-4ac1-af73-770ee5caf200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:01.482910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-40abab5e-8efd-4ac1-af73-770ee5caf200 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:01.484133 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-40abab5e-8efd-4ac1-af73-770ee5caf200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:01.513535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:01.582738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:01.873484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da9822-5a54-4d21-b777-3058a3b900d3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:01.875212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-92da9822-5a54-4d21-b777-3058a3b900d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:01.977498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da9822-5a54-4d21-b777-3058a3b900d3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:02.006646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:02.052190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415da05-1fb3-40c3-a20a-38c4e4612dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:02.052794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415da05-1fb3-40c3-a20a-38c4e4612dcb service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:02.053073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415da05-1fb3-40c3-a20a-38c4e4612dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:02.053343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415da05-1fb3-40c3-a20a-38c4e4612dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:02.054987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5415da05-1fb3-40c3-a20a-38c4e4612dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:02.163378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415da05-1fb3-40c3-a20a-38c4e4612dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:02.164831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415da05-1fb3-40c3-a20a-38c4e4612dcb service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:02.182605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 734/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:04.170285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e7632-6472-43b9-a553-0262ae28e394 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:04.170825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e7632-6472-43b9-a553-0262ae28e394 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:04.170825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e7632-6472-43b9-a553-0262ae28e394 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:04.172235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:04.178006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05003a-beb7-43d1-ae40-9275d94dbef4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:04.178481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05003a-beb7-43d1-ae40-9275d94dbef4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:04.178581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05003a-beb7-43d1-ae40-9275d94dbef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:04.245395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0c05003a-beb7-43d1-ae40-9275d94dbef4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:04.246642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0c05003a-beb7-43d1-ae40-9275d94dbef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:04.255155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:04.342451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:04.629404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e7632-6472-43b9-a553-0262ae28e394 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:04.630987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a13e7632-6472-43b9-a553-0262ae28e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:04.734528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e7632-6472-43b9-a553-0262ae28e394 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:04.792113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:04.810842 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe946116-d25c-4a8c-a17b-db7b189c486e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:04.811444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946116-d25c-4a8c-a17b-db7b189c486e service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:04.811722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946116-d25c-4a8c-a17b-db7b189c486e service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:04.811989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946116-d25c-4a8c-a17b-db7b189c486e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:04.814190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fe946116-d25c-4a8c-a17b-db7b189c486e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:04.921313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe946116-d25c-4a8c-a17b-db7b189c486e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:04.922748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe946116-d25c-4a8c-a17b-db7b189c486e service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:04.941831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 726/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:06.924386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75a09d-8a49-4d63-b206-ebdff2ae5da9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:06.924947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75a09d-8a49-4d63-b206-ebdff2ae5da9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:06.925043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75a09d-8a49-4d63-b206-ebdff2ae5da9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:06.926525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:06.931877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803baa8-de26-4f59-bb15-ba5608b83777 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:06.932331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803baa8-de26-4f59-bb15-ba5608b83777 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:06.932441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803baa8-de26-4f59-bb15-ba5608b83777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:06.998227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8803baa8-de26-4f59-bb15-ba5608b83777 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:06.999432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8803baa8-de26-4f59-bb15-ba5608b83777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:07.038038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:07.102057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:07.388811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75a09d-8a49-4d63-b206-ebdff2ae5da9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:07.390411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cc75a09d-8a49-4d63-b206-ebdff2ae5da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:07.495944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75a09d-8a49-4d63-b206-ebdff2ae5da9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:07.536104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:07.575680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16616f26-a156-4bcd-8c78-d78336481a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:07.576282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16616f26-a156-4bcd-8c78-d78336481a44 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:07.576557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16616f26-a156-4bcd-8c78-d78336481a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:07.576831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16616f26-a156-4bcd-8c78-d78336481a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:07.583791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-16616f26-a156-4bcd-8c78-d78336481a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:07.694403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16616f26-a156-4bcd-8c78-d78336481a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:07.695758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16616f26-a156-4bcd-8c78-d78336481a44 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:07.714723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 737/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:09.669071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4554-202e-4777-bfb5-99eb7e35972d None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:09.669654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4554-202e-4777-bfb5-99eb7e35972d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:09.669654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4554-202e-4777-bfb5-99eb7e35972d None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:09.671006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:09.677065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243006-9ac7-4f7e-9e7d-f9889e36eff6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:09.677522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243006-9ac7-4f7e-9e7d-f9889e36eff6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:09.677618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243006-9ac7-4f7e-9e7d-f9889e36eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:09.744598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-15243006-9ac7-4f7e-9e7d-f9889e36eff6 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:09.745807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-15243006-9ac7-4f7e-9e7d-f9889e36eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:09.763825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:09.842747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:10.134375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4554-202e-4777-bfb5-99eb7e35972d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:10.136067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-544a4554-202e-4777-bfb5-99eb7e35972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:10.239471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4554-202e-4777-bfb5-99eb7e35972d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:10.305883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:10.313331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478c4a9-17f6-40a4-a3c2-decec6d19480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:10.314716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478c4a9-17f6-40a4-a3c2-decec6d19480 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:10.314993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478c4a9-17f6-40a4-a3c2-decec6d19480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:10.315261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478c4a9-17f6-40a4-a3c2-decec6d19480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:10.316918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2478c4a9-17f6-40a4-a3c2-decec6d19480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:10.426530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478c4a9-17f6-40a4-a3c2-decec6d19480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:10.427898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478c4a9-17f6-40a4-a3c2-decec6d19480 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:10.446401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 729/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:12.387224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb7c1-673d-4ebc-ad29-b8f794a7a765 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:12.387773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb7c1-673d-4ebc-ad29-b8f794a7a765 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:12.387773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fb7c1-673d-4ebc-ad29-b8f794a7a765 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:12.389061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:12.394353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214956-f112-4a91-82d4-613d60ad5f3f None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:12.394817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214956-f112-4a91-82d4-613d60ad5f3f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:12.394924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214956-f112-4a91-82d4-613d60ad5f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:12.460710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-83214956-f112-4a91-82d4-613d60ad5f3f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:12.461954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-83214956-f112-4a91-82d4-613d60ad5f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:12.510393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:12.559512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:12.840523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb7c1-673d-4ebc-ad29-b8f794a7a765 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:12.842124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-197fb7c1-673d-4ebc-ad29-b8f794a7a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:12.944690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fb7c1-673d-4ebc-ad29-b8f794a7a765 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:12.992197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:13.018004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e5732-236f-4bae-a41c-4f3b4a13d0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:13.018613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5732-236f-4bae-a41c-4f3b4a13d0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:13.018902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5732-236f-4bae-a41c-4f3b4a13d0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:13.019173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e5732-236f-4bae-a41c-4f3b4a13d0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:13.020780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-297e5732-236f-4bae-a41c-4f3b4a13d0a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:13.132008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5732-236f-4bae-a41c-4f3b4a13d0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:13.133583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e5732-236f-4bae-a41c-4f3b4a13d0a9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:13.153142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 740/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:22.557735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=22 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:23.150800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=66 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:32.996099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2bea4-3fe6-46df-9815-edbda8b173e8 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:32.996682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2bea4-3fe6-46df-9815-edbda8b173e8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:32.996682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2bea4-3fe6-46df-9815-edbda8b173e8 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:32.998069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 731/1471] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:33.003840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9b27b-83ef-444f-a200-7f9b1115fc9b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:33.004300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9b27b-83ef-444f-a200-7f9b1115fc9b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:33.004413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9b27b-83ef-444f-a200-7f9b1115fc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:33.070962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-23b9b27b-83ef-444f-a200-7f9b1115fc9b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:33.072347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-23b9b27b-83ef-444f-a200-7f9b1115fc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:33.169764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 741/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:33.467194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dc2c-ca74-43ed-ab1d-5db5764caabf None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:33.467482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dc2c-ca74-43ed-ab1d-5db5764caabf None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:33.467759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dc2c-ca74-43ed-ab1d-5db5764caabf None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:33.469154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 732/1473] 10.222.0.20 () {54 vars in 967 bytes} [Fri Aug 26 15:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:33.474360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d4fd-9795-4f1a-820f-11891dd1ada0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:33.474657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d4fd-9795-4f1a-820f-11891dd1ada0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:33.474935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d4fd-9795-4f1a-820f-11891dd1ada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:33.552860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4e79d4fd-9795-4f1a-820f-11891dd1ada0 None None] MFA Rules not processed for user `a0c16885de9e4e82bcbede361e548ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:33.554126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4e79d4fd-9795-4f1a-820f-11891dd1ada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:33.575115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:33.632035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 742/1474] 10.222.0.20 () {58 vars in 1064 bytes} [Fri Aug 26 15:34:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:33.639477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7dc2c-ca74-43ed-ab1d-5db5764caabf None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:33.641643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d1c7dc2c-ca74-43ed-ab1d-5db5764caabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:33.745746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7dc2c-ca74-43ed-ab1d-5db5764caabf None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:33.819807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b7222-bbe0-4791-b26e-bca0e01c8c1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c16885de9e4e82bcbede361e548ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:33.820413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b7222-bbe0-4791-b26e-bca0e01c8c1a service glance] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:33.820694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b7222-bbe0-4791-b26e-bca0e01c8c1a service glance] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:33.820973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b7222-bbe0-4791-b26e-bca0e01c8c1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:33.822627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f87b7222-bbe0-4791-b26e-bca0e01c8c1a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:33.876374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:33.932281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b7222-bbe0-4791-b26e-bca0e01c8c1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:33.933737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b7222-bbe0-4791-b26e-bca0e01c8c1a service glance] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:33.953700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 733/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:35.991656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7c8e6-5fdb-41b9-9d87-8d72d239cf2c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:35.992221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7c8e6-5fdb-41b9-9d87-8d72d239cf2c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:35.992221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7c8e6-5fdb-41b9-9d87-8d72d239cf2c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:35.993634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 743/1476] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:35.998975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a817a-d1dd-4496-b892-968592066041 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:35.999432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a817a-d1dd-4496-b892-968592066041 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:35.999538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a817a-d1dd-4496-b892-968592066041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:36.067567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-437a817a-d1dd-4496-b892-968592066041 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:36.068777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-437a817a-d1dd-4496-b892-968592066041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:36.176295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 734/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:36.457441 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7c8e6-5fdb-41b9-9d87-8d72d239cf2c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:36.458960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-82b7c8e6-5fdb-41b9-9d87-8d72d239cf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:36.587318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7c8e6-5fdb-41b9-9d87-8d72d239cf2c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:36.636584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:36.681280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6d3ba-17a9-459a-8bd2-762eb6cd0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:36.681912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6d3ba-17a9-459a-8bd2-762eb6cd0338 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:36.682197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6d3ba-17a9-459a-8bd2-762eb6cd0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:36.682471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6d3ba-17a9-459a-8bd2-762eb6cd0338 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:36.683138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6d3ba-17a9-459a-8bd2-762eb6cd0338 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:36.684913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING py.warnings [None req-f6d6d3ba-17a9-459a-8bd2-762eb6cd0338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:34:36.684913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: warnings.warn(msg) Aug 26 15:34:36.684913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: Aug 26 15:34:36.686105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6d3ba-17a9-459a-8bd2-762eb6cd0338 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:36.706109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 744/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 15:34:36 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:34:38.679165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33be688-c5f2-425f-a8ec-927870b5e9e3 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:38.679706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33be688-c5f2-425f-a8ec-927870b5e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:38.679706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33be688-c5f2-425f-a8ec-927870b5e9e3 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:38.681093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 735/1479] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:38.686427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475711-6673-4104-9071-170e67380fe2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:38.686836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475711-6673-4104-9071-170e67380fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:38.686932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475711-6673-4104-9071-170e67380fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:38.753288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-35475711-6673-4104-9071-170e67380fe2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:38.754576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-35475711-6673-4104-9071-170e67380fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:38.851727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 745/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:39.149767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33be688-c5f2-425f-a8ec-927870b5e9e3 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:39.151415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c33be688-c5f2-425f-a8ec-927870b5e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:39.161745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:39.302748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33be688-c5f2-425f-a8ec-927870b5e9e3 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:39.383367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:39.416647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270b99b-7fb0-4659-8e33-f88a8019f4e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:39.417256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b99b-7fb0-4659-8e33-f88a8019f4e2 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:39.417538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b99b-7fb0-4659-8e33-f88a8019f4e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:39.417817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b99b-7fb0-4659-8e33-f88a8019f4e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:39.419467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f270b99b-7fb0-4659-8e33-f88a8019f4e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:39.507790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b99b-7fb0-4659-8e33-f88a8019f4e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:39.509401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b99b-7fb0-4659-8e33-f88a8019f4e2 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:39.528259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 736/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:41.651752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a8d28-4cef-48f1-a359-0bfc8d7a38dc None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:41.652363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a8d28-4cef-48f1-a359-0bfc8d7a38dc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:41.652363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a8d28-4cef-48f1-a359-0bfc8d7a38dc None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:41.653670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 746/1482] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:41.659927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5704-c49e-4e13-b344-6573f4e30fcb None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:41.660358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5704-c49e-4e13-b344-6573f4e30fcb None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:41.660468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5704-c49e-4e13-b344-6573f4e30fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:41.728064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-dd3e5704-c49e-4e13-b344-6573f4e30fcb None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:41.729174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-dd3e5704-c49e-4e13-b344-6573f4e30fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:41.776026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:41.826616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 737/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:42.115517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a8d28-4cef-48f1-a359-0bfc8d7a38dc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:42.117141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ea9a8d28-4cef-48f1-a359-0bfc8d7a38dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:42.141373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:42.220124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a8d28-4cef-48f1-a359-0bfc8d7a38dc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:42.294112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885c216-7086-4305-8c01-042f232aaa28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:42.294721 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885c216-7086-4305-8c01-042f232aaa28 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:42.295004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885c216-7086-4305-8c01-042f232aaa28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:42.295277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885c216-7086-4305-8c01-042f232aaa28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:42.296914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c885c216-7086-4305-8c01-042f232aaa28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:42.370846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:42.407814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885c216-7086-4305-8c01-042f232aaa28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:42.409272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885c216-7086-4305-8c01-042f232aaa28 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:42.427124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 747/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:44.393956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565d67a-6c69-4215-91a5-c21d5d6ee382 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:44.394534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565d67a-6c69-4215-91a5-c21d5d6ee382 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:44.394534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565d67a-6c69-4215-91a5-c21d5d6ee382 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:44.395873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 738/1485] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:44.401343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba686-9a57-436a-80da-90b4830e1330 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:44.401750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba686-9a57-436a-80da-90b4830e1330 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:44.401921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba686-9a57-436a-80da-90b4830e1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:44.467277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d54ba686-9a57-436a-80da-90b4830e1330 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:44.468484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d54ba686-9a57-436a-80da-90b4830e1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:44.568528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 748/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:44.857669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565d67a-6c69-4215-91a5-c21d5d6ee382 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:44.859369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1565d67a-6c69-4215-91a5-c21d5d6ee382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:44.966466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565d67a-6c69-4215-91a5-c21d5d6ee382 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:45.038798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:45.040695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f0bbd-2f6f-4664-819d-14c3a5d03645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:45.041319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f0bbd-2f6f-4664-819d-14c3a5d03645 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:45.041792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f0bbd-2f6f-4664-819d-14c3a5d03645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:45.042241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f0bbd-2f6f-4664-819d-14c3a5d03645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:45.044075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-929f0bbd-2f6f-4664-819d-14c3a5d03645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:45.153363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f0bbd-2f6f-4664-819d-14c3a5d03645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:45.154855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f0bbd-2f6f-4664-819d-14c3a5d03645 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:45.174120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 739/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:47.324102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb7b7-f816-4c74-a766-14bdeb3be1d8 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:47.324679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb7b7-f816-4c74-a766-14bdeb3be1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:47.324679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eb7b7-f816-4c74-a766-14bdeb3be1d8 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:47.326094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 749/1488] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:47.332208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4c53c-f17b-4253-a77c-1eb4d23aefca None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:47.332643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4c53c-f17b-4253-a77c-1eb4d23aefca None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:47.332756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4c53c-f17b-4253-a77c-1eb4d23aefca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:47.399196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-9fa4c53c-f17b-4253-a77c-1eb4d23aefca None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:47.400313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9fa4c53c-f17b-4253-a77c-1eb4d23aefca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:47.452540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:47.497154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 740/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:47.793255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb7b7-f816-4c74-a766-14bdeb3be1d8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:47.794835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-644eb7b7-f816-4c74-a766-14bdeb3be1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:47.832989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:47.902280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eb7b7-f816-4c74-a766-14bdeb3be1d8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:47.976984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56168e27-099d-49c0-91c1-eac5f57ab4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:47.977588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168e27-099d-49c0-91c1-eac5f57ab4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:47.977892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168e27-099d-49c0-91c1-eac5f57ab4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:47.978167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56168e27-099d-49c0-91c1-eac5f57ab4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:47.979765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-56168e27-099d-49c0-91c1-eac5f57ab4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:48.063618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:48.093025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56168e27-099d-49c0-91c1-eac5f57ab4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:48.095211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56168e27-099d-49c0-91c1-eac5f57ab4d7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:48.113446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 750/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:50.206582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db66c0-75d8-4d1b-a135-cb54322f2540 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:50.207144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db66c0-75d8-4d1b-a135-cb54322f2540 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:50.207144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db66c0-75d8-4d1b-a135-cb54322f2540 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:50.208545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 741/1491] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 15:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:50.213728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ace95-ec9c-4168-9b37-107913c67db0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:50.214200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ace95-ec9c-4168-9b37-107913c67db0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:50.214311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ace95-ec9c-4168-9b37-107913c67db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:50.280445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-936ace95-ec9c-4168-9b37-107913c67db0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:50.281808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-936ace95-ec9c-4168-9b37-107913c67db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:50.377639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 751/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:50.673699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db66c0-75d8-4d1b-a135-cb54322f2540 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:50.675299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-62db66c0-75d8-4d1b-a135-cb54322f2540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:50.780611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db66c0-75d8-4d1b-a135-cb54322f2540 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:50.852561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb6d93-146e-43e0-85ce-c102228f43a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:50.853161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6d93-146e-43e0-85ce-c102228f43a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:50.853441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6d93-146e-43e0-85ce-c102228f43a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:50.853717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6d93-146e-43e0-85ce-c102228f43a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:50.855341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-21cb6d93-146e-43e0-85ce-c102228f43a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:50.864525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:50.966387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6d93-146e-43e0-85ce-c102228f43a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:50.967767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6d93-146e-43e0-85ce-c102228f43a2 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:50.986458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 742/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:35:00.375519 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=82 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:35:00.983572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=50 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:12.612387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0c46c-f6ba-46e1-b1ad-b0a0a89e0a9e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:12.612991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0c46c-f6ba-46e1-b1ad-b0a0a89e0a9e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:12.612991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0c46c-f6ba-46e1-b1ad-b0a0a89e0a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:12.690004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-66d0c46c-f6ba-46e1-b1ad-b0a0a89e0a9e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:12.691208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-66d0c46c-f6ba-46e1-b1ad-b0a0a89e0a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:12.784699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 752/1494] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:12.792719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0c74-55de-4cff-91c3-9a68691f896b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:12.793218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0c74-55de-4cff-91c3-9a68691f896b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:12.793329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0c74-55de-4cff-91c3-9a68691f896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:12.871818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-116e0c74-55de-4cff-91c3-9a68691f896b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:12.872938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-116e0c74-55de-4cff-91c3-9a68691f896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:12.969903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 743/1495] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:36:12.974610 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0c46c-f6ba-46e1-b1ad-b0a0a89e0a9e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:12.975858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-66d0c46c-f6ba-46e1-b1ad-b0a0a89e0a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:12.987771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0c46c-f6ba-46e1-b1ad-b0a0a89e0a9e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:13.054044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:13.087770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:13.088374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:13.088652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:13.088922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:13.089556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:36:13.089877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:13.090888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING py.warnings [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:13.090888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: warnings.warn(msg) Aug 26 15:36:13.090888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: Aug 26 15:36:13.091770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:13.102755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 753/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:36:13.111379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e0c74-55de-4cff-91c3-9a68691f896b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:13.120875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e0c74-55de-4cff-91c3-9a68691f896b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:13.305974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:13.339951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:13.340554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:13.340831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:13.341097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:13.341719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:13.343519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING py.warnings [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:13.343519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: warnings.warn(msg) Aug 26 15:36:13.343519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: Aug 26 15:36:13.344807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:13.401015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 744/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:36:13 2022] POST /identity/v3/projects => generated 379 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:36:13.405328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:13.408145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:13.442121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ac43a-d0bf-48c9-a77e-1b3e280c1ba1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:13.536455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:13.537065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:13.537343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:13.537613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:13.538276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:13.539281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING py.warnings [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:13.539281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: warnings.warn(msg) Aug 26 15:36:13.539281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: Aug 26 15:36:13.540488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:13.582542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 754/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:36:13 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:36:13.586678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:13.588175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:13.655824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df06bf-28aa-456b-a682-10c9b4ebce63 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:13.742820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:13.754563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:13.755161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:13.755436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:13.755702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:13.756333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:13.757344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING py.warnings [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:13.757344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: warnings.warn(msg) Aug 26 15:36:13.757344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: Aug 26 15:36:13.758240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:13.771911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 745/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:36:13.776028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:13.777553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:13.789493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206b667-0b0d-40e8-95b3-5a83e94ec7ff admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:13.814642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:13.884865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa7765-f547-4656-8852-6af96e1d0a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:13.885473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa7765-f547-4656-8852-6af96e1d0a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:13.885752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa7765-f547-4656-8852-6af96e1d0a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:13.886054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa7765-f547-4656-8852-6af96e1d0a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:13.886697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa7765-f547-4656-8852-6af96e1d0a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:13.887714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING py.warnings [None req-50fa7765-f547-4656-8852-6af96e1d0a46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:13.887714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: warnings.warn(msg) Aug 26 15:36:13.887714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: Aug 26 15:36:13.888601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa7765-f547-4656-8852-6af96e1d0a46 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:13.901624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 755/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:36:13.905922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:13.907472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:13.940230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388331c-d64c-4349-a991-1c2f7e8045c4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:14.035327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46436ea8-ccbb-497b-95c6-addbb37d24f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:14.035985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46436ea8-ccbb-497b-95c6-addbb37d24f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:14.036268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46436ea8-ccbb-497b-95c6-addbb37d24f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:14.036547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46436ea8-ccbb-497b-95c6-addbb37d24f2 admin admin] PATH_INFO: `/v3/projects/acf2e055e0be400e9b8836dc7c04bdd0/users/3aff67df6ffc4676894d26a3d89489b1/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:14.059952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46436ea8-ccbb-497b-95c6-addbb37d24f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf2e055e0be400e9b8836dc7c04bdd0, user_id=3aff67df6ffc4676894d26a3d89489b1, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:14.060989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING py.warnings [None req-46436ea8-ccbb-497b-95c6-addbb37d24f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:14.060989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: warnings.warn(msg) Aug 26 15:36:14.060989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: Aug 26 15:36:14.063246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46436ea8-ccbb-497b-95c6-addbb37d24f2 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:14.086900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 746/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:36:13 2022] PUT /identity/v3/projects/acf2e055e0be400e9b8836dc7c04bdd0/users/3aff67df6ffc4676894d26a3d89489b1/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:36:14.099853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcbc6-f0b2-46a2-94c7-b560066c20cd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:14.100239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcbc6-f0b2-46a2-94c7-b560066c20cd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:14.100591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcbc6-f0b2-46a2-94c7-b560066c20cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:14.159142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6b9fcbc6-f0b2-46a2-94c7-b560066c20cd None None] MFA Rules not processed for user `3aff67df6ffc4676894d26a3d89489b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:14.160283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b9fcbc6-f0b2-46a2-94c7-b560066c20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:14.355963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 756/1502] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:36:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:14.370420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f41e7-e135-42b1-98fc-3f0112b6175f None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:14.370700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f41e7-e135-42b1-98fc-3f0112b6175f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:14.370968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f41e7-e135-42b1-98fc-3f0112b6175f None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:14.372300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 747/1503] 10.222.0.20 () {54 vars in 964 bytes} [Fri Aug 26 15:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:36:14.377897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80387b-b2b1-4895-8b9f-0295cbaf5d48 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:14.378186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80387b-b2b1-4895-8b9f-0295cbaf5d48 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:14.378458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80387b-b2b1-4895-8b9f-0295cbaf5d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:14.408864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:14.454291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fd80387b-b2b1-4895-8b9f-0295cbaf5d48 None None] MFA Rules not processed for user `3adaa1462c8a4acdab7e631a795cd40f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:14.455424 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fd80387b-b2b1-4895-8b9f-0295cbaf5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:14.532491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 757/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Aug 26 15:36:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:14.540309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f41e7-e135-42b1-98fc-3f0112b6175f None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:14.541910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3a1f41e7-e135-42b1-98fc-3f0112b6175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:14.591225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:14.646178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f41e7-e135-42b1-98fc-3f0112b6175f None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:14.718954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:14.719509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:14.719788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:14.720065 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:14.721741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:14.818893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:14.820335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:14.823795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:14.842170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 748/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:36:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:36:14.887151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9adc-ede2-498c-82c2-74b1fdbde5d9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:14.887559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9adc-ede2-498c-82c2-74b1fdbde5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:14.887698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f9adc-ede2-498c-82c2-74b1fdbde5d9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:14.888957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 758/1506] 10.222.0.20 () {52 vars in 830 bytes} [Fri Aug 26 15:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:36:14.893257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:14.894536 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:14.994480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135720d-ed72-4091-adb4-cf78e1a7c7ff service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:15.086164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:15.086786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:15.087064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:15.087331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] PATH_INFO: `/v3/users/3aff67df6ffc4676894d26a3d89489b1` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:15.099366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aff67df6ffc4676894d26a3d89489b1)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:15.100392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING py.warnings [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:15.100392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: warnings.warn(msg) Aug 26 15:36:15.100392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: Aug 26 15:36:15.101602 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:15.111702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:15.169760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aff67df6ffc4676894d26a3d89489b1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:15.170224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aff67df6ffc4676894d26a3d89489b1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:15.192719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aff67df6ffc4676894d26a3d89489b1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:15.201983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aff67df6ffc4676894d26a3d89489b1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:15.202507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aff67df6ffc4676894d26a3d89489b1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:15.222727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 749/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:36:14 2022] DELETE /identity/v3/users/3aff67df6ffc4676894d26a3d89489b1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:36:15.227201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af04-6654-413f-b822-f1b499d87458 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:15.227489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af04-6654-413f-b822-f1b499d87458 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:15.227765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af04-6654-413f-b822-f1b499d87458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:15.292489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c136af04-6654-413f-b822-f1b499d87458 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:15.293695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c136af04-6654-413f-b822-f1b499d87458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:15.367354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:15.381277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 759/1508] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:15.391600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:15.392837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:15.492785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b79a47-0f60-467f-9a4e-1f9798df3381 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:15.548183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:15.568505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e8f05-185f-439b-81c5-d83a50839533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:15.569112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e8f05-185f-439b-81c5-d83a50839533 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:15.569393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e8f05-185f-439b-81c5-d83a50839533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:15.569670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e8f05-185f-439b-81c5-d83a50839533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:15.571329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-199e8f05-185f-439b-81c5-d83a50839533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:15.684131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e8f05-185f-439b-81c5-d83a50839533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:15.685574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e8f05-185f-439b-81c5-d83a50839533 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:15.708055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 750/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:36:16.058385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136af04-6654-413f-b822-f1b499d87458 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:16.059729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c136af04-6654-413f-b822-f1b499d87458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:16.072492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136af04-6654-413f-b822-f1b499d87458 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:16.170063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:16.170691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:16.170966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:16.171239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] PATH_INFO: `/v3/projects/acf2e055e0be400e9b8836dc7c04bdd0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:16.182087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf2e055e0be400e9b8836dc7c04bdd0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:16.183105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING py.warnings [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:16.183105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: warnings.warn(msg) Aug 26 15:36:16.183105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: Aug 26 15:36:16.184288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:16.241961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf2e055e0be400e9b8836dc7c04bdd0', 'request_id': 'req-767f3207-9aa5-42fe-8427-b53aa75142a3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:16.251050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf2e055e0be400e9b8836dc7c04bdd0', 'request_id': 'req-767f3207-9aa5-42fe-8427-b53aa75142a3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:16.257040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf2e055e0be400e9b8836dc7c04bdd0', 'request_id': 'req-767f3207-9aa5-42fe-8427-b53aa75142a3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:16.288632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] The token cache is being invalidate because project acf2e055e0be400e9b8836dc7c04bdd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:36:16.288920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:16.289449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767f3207-9aa5-42fe-8427-b53aa75142a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:16.290806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 760/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:36:16 2022] DELETE /identity/v3/projects/acf2e055e0be400e9b8836dc7c04bdd0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:36:25.705648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=62 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:26.286622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:37:55.277576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f662-acf7-40b3-a75d-4ecbb7a5be2e None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:37:55.278203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f662-acf7-40b3-a75d-4ecbb7a5be2e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:37:55.278203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f662-acf7-40b3-a75d-4ecbb7a5be2e None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:37:55.279547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:37:55.285146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f4b3-3746-42d7-afd6-16b77b5257c1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:37:55.285565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f4b3-3746-42d7-afd6-16b77b5257c1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:37:55.285697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f4b3-3746-42d7-afd6-16b77b5257c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:37:55.366506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a180f4b3-3746-42d7-afd6-16b77b5257c1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:37:55.367699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a180f4b3-3746-42d7-afd6-16b77b5257c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:37:55.468016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:37:55.626206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f662-acf7-40b3-a75d-4ecbb7a5be2e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:37:55.628370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8046f662-acf7-40b3-a75d-4ecbb7a5be2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:37:55.747933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f662-acf7-40b3-a75d-4ecbb7a5be2e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:37:55.754215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ca9b2-f54f-49b5-b2d2-1cef938b0106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:37:55.754819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca9b2-f54f-49b5-b2d2-1cef938b0106 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:37:55.755103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca9b2-f54f-49b5-b2d2-1cef938b0106 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:37:55.755378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ca9b2-f54f-49b5-b2d2-1cef938b0106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:37:55.763583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ca9b2-f54f-49b5-b2d2-1cef938b0106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:37:55.765864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ca9b2-f54f-49b5-b2d2-1cef938b0106 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:37:55.775359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 752/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:37:56.619713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bd9f1-1963-48d0-b1fc-19ff98740e9c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:37:56.620236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bd9f1-1963-48d0-b1fc-19ff98740e9c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:37:56.620236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bd9f1-1963-48d0-b1fc-19ff98740e9c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:37:56.621638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:37:56.626776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849b30-a2ec-481d-835c-07f42cbc1a8e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:37:56.627213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849b30-a2ec-481d-835c-07f42cbc1a8e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:37:56.627320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849b30-a2ec-481d-835c-07f42cbc1a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:37:56.646528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-6d849b30-a2ec-481d-835c-07f42cbc1a8e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:37:56.647707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6d849b30-a2ec-481d-835c-07f42cbc1a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:37:56.655390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:37:56.809095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bd9f1-1963-48d0-b1fc-19ff98740e9c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:37:56.823591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bd9f1-1963-48d0-b1fc-19ff98740e9c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:37:56.829194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968898da-e100-4b2c-997f-d4141ad1a956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:37:56.829783 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968898da-e100-4b2c-997f-d4141ad1a956 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:37:56.830088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968898da-e100-4b2c-997f-d4141ad1a956 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:37:56.830383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968898da-e100-4b2c-997f-d4141ad1a956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:37:56.838562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968898da-e100-4b2c-997f-d4141ad1a956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:37:56.840195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968898da-e100-4b2c-997f-d4141ad1a956 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:37:56.851279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 763/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:37:56.876934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975166-80f9-4f44-80c9-0a1562fec44e None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:37:56.877222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975166-80f9-4f44-80c9-0a1562fec44e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:37:56.877502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975166-80f9-4f44-80c9-0a1562fec44e None None] PATH_INFO: `/v3` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:37:56.878880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 754/1517] 10.222.0.97 () {54 vars in 925 bytes} [Fri Aug 26 15:37:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:37:56.885418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c900-a644-4f99-a930-67e8d3eed4d6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:37:56.885708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c900-a644-4f99-a930-67e8d3eed4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:37:56.886025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c900-a644-4f99-a930-67e8d3eed4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:37:56.955656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e870c900-a644-4f99-a930-67e8d3eed4d6 None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:37:56.956731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e870c900-a644-4f99-a930-67e8d3eed4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:37:56.973943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:37:57.028330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 764/1518] 10.222.0.97 () {58 vars in 1015 bytes} [Fri Aug 26 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:38:05.879431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12653-bc3b-40b7-a593-26cc08d07ccd None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:05.879971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12653-bc3b-40b7-a593-26cc08d07ccd None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:05.879971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12653-bc3b-40b7-a593-26cc08d07ccd None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:05.881364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 755/1519] 10.222.0.20 () {54 vars in 961 bytes} [Fri Aug 26 15:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:05.886535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990c2db-7784-453f-afc4-2dfff4f8951b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:05.887021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990c2db-7784-453f-afc4-2dfff4f8951b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:05.887128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990c2db-7784-453f-afc4-2dfff4f8951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:05.908787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8990c2db-7784-453f-afc4-2dfff4f8951b None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:05.910028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8990c2db-7784-453f-afc4-2dfff4f8951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:05.918459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 765/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Aug 26 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:05.926662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12653-bc3b-40b7-a593-26cc08d07ccd None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:05.940562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12653-bc3b-40b7-a593-26cc08d07ccd None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:05.945481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778008-e1a4-4977-ab36-423984b48d6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:05.946101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778008-e1a4-4977-ab36-423984b48d6b service placement] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:05.946380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778008-e1a4-4977-ab36-423984b48d6b service placement] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:05.946649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778008-e1a4-4977-ab36-423984b48d6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:05.954764 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0778008-e1a4-4977-ab36-423984b48d6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:05.956332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0778008-e1a4-4977-ab36-423984b48d6b service placement] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:05.966077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 756/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:08.078490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c485bb3-a9bd-4555-aebb-19caad264a12 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:08.079167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c485bb3-a9bd-4555-aebb-19caad264a12 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:08.079167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c485bb3-a9bd-4555-aebb-19caad264a12 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:08.080382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:08.085125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66aed1-ca78-4929-b7dd-52d04bb555fa None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:08.085558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66aed1-ca78-4929-b7dd-52d04bb555fa None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:08.085680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66aed1-ca78-4929-b7dd-52d04bb555fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:08.105205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-cf66aed1-ca78-4929-b7dd-52d04bb555fa None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:08.106424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-cf66aed1-ca78-4929-b7dd-52d04bb555fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:08.115101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:08.272012 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c485bb3-a9bd-4555-aebb-19caad264a12 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:08.287921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c485bb3-a9bd-4555-aebb-19caad264a12 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:08.293177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6c4c5-c7ea-44f6-be0e-721509371ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:08.293768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6c4c5-c7ea-44f6-be0e-721509371ac4 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:08.294082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6c4c5-c7ea-44f6-be0e-721509371ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:08.294351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6c4c5-c7ea-44f6-be0e-721509371ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:08.302688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6c4c5-c7ea-44f6-be0e-721509371ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:08.304250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6c4c5-c7ea-44f6-be0e-721509371ac4 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:08.313866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 767/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:09.147876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204b86-6f14-4de3-95ae-4f3291c4dec3 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:09.148375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204b86-6f14-4de3-95ae-4f3291c4dec3 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:09.148481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50204b86-6f14-4de3-95ae-4f3291c4dec3 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:09.149756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:09.154513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8ed2-a6c3-427f-b117-1e2c22a42c37 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:09.154963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8ed2-a6c3-427f-b117-1e2c22a42c37 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:09.155101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8ed2-a6c3-427f-b117-1e2c22a42c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:09.174710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f20c8ed2-a6c3-427f-b117-1e2c22a42c37 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:09.175908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f20c8ed2-a6c3-427f-b117-1e2c22a42c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:09.183690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:09.343218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50204b86-6f14-4de3-95ae-4f3291c4dec3 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:09.357313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50204b86-6f14-4de3-95ae-4f3291c4dec3 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:09.362743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d48040-c7a2-4d8c-904c-4047dc9141fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:09.363328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48040-c7a2-4d8c-904c-4047dc9141fa service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:09.363607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48040-c7a2-4d8c-904c-4047dc9141fa service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:09.363881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d48040-c7a2-4d8c-904c-4047dc9141fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:09.372071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d48040-c7a2-4d8c-904c-4047dc9141fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:09.373681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d48040-c7a2-4d8c-904c-4047dc9141fa service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:09.383942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 759/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:13.380674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588e8b3-93e0-4780-a8b8-993bf6a0e2d6 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:13.381230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588e8b3-93e0-4780-a8b8-993bf6a0e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:13.381230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588e8b3-93e0-4780-a8b8-993bf6a0e2d6 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:13.382530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:13.387674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2d9df-b824-48ac-b9f2-1a9b32f374d1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:13.388131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2d9df-b824-48ac-b9f2-1a9b32f374d1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:13.388268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2d9df-b824-48ac-b9f2-1a9b32f374d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:13.408888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-7ad2d9df-b824-48ac-b9f2-1a9b32f374d1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:13.410140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7ad2d9df-b824-48ac-b9f2-1a9b32f374d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:13.418026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:13.707136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588e8b3-93e0-4780-a8b8-993bf6a0e2d6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:13.708890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4588e8b3-93e0-4780-a8b8-993bf6a0e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:13.792121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588e8b3-93e0-4780-a8b8-993bf6a0e2d6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:13.795750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a994c5-deb3-4c3c-b1a0-c0323e8b3bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:13.796353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a994c5-deb3-4c3c-b1a0-c0323e8b3bca service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:13.796707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a994c5-deb3-4c3c-b1a0-c0323e8b3bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:13.796988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a994c5-deb3-4c3c-b1a0-c0323e8b3bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:13.806240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a994c5-deb3-4c3c-b1a0-c0323e8b3bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:13.807693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a994c5-deb3-4c3c-b1a0-c0323e8b3bca service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:13.817745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 770/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:15.740844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde275e-5a50-4507-9620-72119e64e08a None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:15.741447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde275e-5a50-4507-9620-72119e64e08a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:15.741447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde275e-5a50-4507-9620-72119e64e08a None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:15.742858 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:15.748151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39292d15-26bf-441b-ae4b-718b63855756 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:15.748601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39292d15-26bf-441b-ae4b-718b63855756 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:15.748707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39292d15-26bf-441b-ae4b-718b63855756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:15.768613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-39292d15-26bf-441b-ae4b-718b63855756 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:15.769810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-39292d15-26bf-441b-ae4b-718b63855756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:15.777645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:16.068242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde275e-5a50-4507-9620-72119e64e08a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:16.069994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bcde275e-5a50-4507-9620-72119e64e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:16.077876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=75 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:38:16.083659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde275e-5a50-4507-9620-72119e64e08a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:16.087227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb8c61-c374-4af6-9744-def4d798218f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:16.087823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8c61-c374-4af6-9744-def4d798218f service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:16.088102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8c61-c374-4af6-9744-def4d798218f service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:16.088373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb8c61-c374-4af6-9744-def4d798218f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:16.097972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb8c61-c374-4af6-9744-def4d798218f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:16.099411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb8c61-c374-4af6-9744-def4d798218f service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:16.108679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 762/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:19.818384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8f9aa-0764-4ce3-8b6c-087a145d213f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:19.818932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8f9aa-0764-4ce3-8b6c-087a145d213f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:19.819054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8f9aa-0764-4ce3-8b6c-087a145d213f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:19.820402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:19.825526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72639-a97e-44fc-926a-346f7ddc593a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:19.825962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72639-a97e-44fc-926a-346f7ddc593a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:19.826125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72639-a97e-44fc-926a-346f7ddc593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:19.845952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-67c72639-a97e-44fc-926a-346f7ddc593a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:19.847165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-67c72639-a97e-44fc-926a-346f7ddc593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:19.854997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:20.413111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8f9aa-0764-4ce3-8b6c-087a145d213f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:20.414815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-38b8f9aa-0764-4ce3-8b6c-087a145d213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:20.480363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:38:20.494120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8f9aa-0764-4ce3-8b6c-087a145d213f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:20.497636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded3805-f4b4-4666-ae9d-b5762ed2f0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:20.498268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded3805-f4b4-4666-ae9d-b5762ed2f0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:20.498547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded3805-f4b4-4666-ae9d-b5762ed2f0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:20.498818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded3805-f4b4-4666-ae9d-b5762ed2f0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:20.508203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded3805-f4b4-4666-ae9d-b5762ed2f0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:20.509624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded3805-f4b4-4666-ae9d-b5762ed2f0b9 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:20.519474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 773/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:22.512293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bae5e8-a708-4993-bbb4-64484b53f6bc None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:22.512811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bae5e8-a708-4993-bbb4-64484b53f6bc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:22.512811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bae5e8-a708-4993-bbb4-64484b53f6bc None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:22.514120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:22.520329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84975c-bb8a-41a1-bba3-793f7123d9e5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:22.520778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84975c-bb8a-41a1-bba3-793f7123d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:22.520876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84975c-bb8a-41a1-bba3-793f7123d9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:22.541774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1c84975c-bb8a-41a1-bba3-793f7123d9e5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:22.543039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c84975c-bb8a-41a1-bba3-793f7123d9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:22.551007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:23.112853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bae5e8-a708-4993-bbb4-64484b53f6bc None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:23.114791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-15bae5e8-a708-4993-bbb4-64484b53f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:23.128377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bae5e8-a708-4993-bbb4-64484b53f6bc None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:23.131978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a150e8-cd44-4919-9f09-40371b333106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:23.132585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a150e8-cd44-4919-9f09-40371b333106 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:23.132866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a150e8-cd44-4919-9f09-40371b333106 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:23.133138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a150e8-cd44-4919-9f09-40371b333106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:23.142564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a150e8-cd44-4919-9f09-40371b333106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:23.144001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a150e8-cd44-4919-9f09-40371b333106 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:23.153396 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 765/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:32.536723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=11 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:38:33.149202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=14 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:52.868503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498c1ff-cd41-44fd-a6db-fbde377ed6f3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:52.869687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498c1ff-cd41-44fd-a6db-fbde377ed6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:52.870240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498c1ff-cd41-44fd-a6db-fbde377ed6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:52.891705 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0498c1ff-cd41-44fd-a6db-fbde377ed6f3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:52.893296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0498c1ff-cd41-44fd-a6db-fbde377ed6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:52.905649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 775/1540] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:52.924850 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3034-d0af-4e4e-a140-06f4eccebc75 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:52.926073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3034-d0af-4e4e-a140-06f4eccebc75 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:52.926570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3034-d0af-4e4e-a140-06f4eccebc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:52.954142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8e0b3034-d0af-4e4e-a140-06f4eccebc75 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:52.955379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8e0b3034-d0af-4e4e-a140-06f4eccebc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:52.970221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 766/1541] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:52.975068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498c1ff-cd41-44fd-a6db-fbde377ed6f3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:52.986478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498c1ff-cd41-44fd-a6db-fbde377ed6f3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:52.997894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:52.998921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:52.999470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:52.999972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.000885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:39:53.001426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.003416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.022084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 776/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:39:53.031480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3034-d0af-4e4e-a140-06f4eccebc75 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.046680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3034-d0af-4e4e-a140-06f4eccebc75 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.056699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8af4d-830e-4d9f-9a10-4fb358da06c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:53.057347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8af4d-830e-4d9f-9a10-4fb358da06c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.057629 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8af4d-830e-4d9f-9a10-4fb358da06c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.057931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8af4d-830e-4d9f-9a10-4fb358da06c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.058596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8af4d-830e-4d9f-9a10-4fb358da06c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.060572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8af4d-830e-4d9f-9a10-4fb358da06c2 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.125958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 767/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:53.139039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.156542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11cedc-8838-437d-9d9e-996a627ba4b4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.194341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d446-f738-4f31-8359-5445bbfb59af None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.194722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d446-f738-4f31-8359-5445bbfb59af None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.194944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d446-f738-4f31-8359-5445bbfb59af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.240540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-2a93d446-f738-4f31-8359-5445bbfb59af None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.243078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2a93d446-f738-4f31-8359-5445bbfb59af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.298697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435591a-e7ec-4517-aa9f-1677c245373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:53.299325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435591a-e7ec-4517-aa9f-1677c245373e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.299608 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435591a-e7ec-4517-aa9f-1677c245373e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.299888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435591a-e7ec-4517-aa9f-1677c245373e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.300525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435591a-e7ec-4517-aa9f-1677c245373e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.302515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435591a-e7ec-4517-aa9f-1677c245373e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.348279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 777/1544] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:53.354125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435591a-e7ec-4517-aa9f-1677c245373e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.372811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435591a-e7ec-4517-aa9f-1677c245373e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.385882 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f4c4-351a-4751-8a3b-2a36aabd06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:53.386445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f4c4-351a-4751-8a3b-2a36aabd06b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.386726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f4c4-351a-4751-8a3b-2a36aabd06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.387001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f4c4-351a-4751-8a3b-2a36aabd06b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.387758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506f4c4-351a-4751-8a3b-2a36aabd06b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.389716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506f4c4-351a-4751-8a3b-2a36aabd06b8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.393191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 768/1545] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.402394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0502f-8220-4817-9df7-f5f9c5d990d0 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.402687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0502f-8220-4817-9df7-f5f9c5d990d0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.402946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0502f-8220-4817-9df7-f5f9c5d990d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.409871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 778/1546] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:39:53.415129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f4c4-351a-4751-8a3b-2a36aabd06b8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.430847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f4c4-351a-4751-8a3b-2a36aabd06b8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.448901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaab01-a444-4602-92b2-9733f2ffc260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:53.449538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaab01-a444-4602-92b2-9733f2ffc260 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.449819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaab01-a444-4602-92b2-9733f2ffc260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.450118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaab01-a444-4602-92b2-9733f2ffc260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.450932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaab01-a444-4602-92b2-9733f2ffc260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.452691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaab01-a444-4602-92b2-9733f2ffc260 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.453644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-83a0502f-8220-4817-9df7-f5f9c5d990d0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.455313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-83a0502f-8220-4817-9df7-f5f9c5d990d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.469191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 779/1547] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:39:53.470499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4c17b-e72a-4a15-9214-ada6a90c1a46 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.470786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4c17b-e72a-4a15-9214-ada6a90c1a46 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.471057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4c17b-e72a-4a15-9214-ada6a90c1a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.487677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 769/1548] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.488516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0502f-8220-4817-9df7-f5f9c5d990d0 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.508784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0502f-8220-4817-9df7-f5f9c5d990d0 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.515583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1bf4c17b-e72a-4a15-9214-ada6a90c1a46 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.516828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1bf4c17b-e72a-4a15-9214-ada6a90c1a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.527509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43503f0-2f36-4476-8a4d-5f8a6245d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:53.528201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43503f0-2f36-4476-8a4d-5f8a6245d68c admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.528485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43503f0-2f36-4476-8a4d-5f8a6245d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.528765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43503f0-2f36-4476-8a4d-5f8a6245d68c admin admin] PATH_INFO: `/v3/projects/6adb2c2b14bf44a2bc20b453a2376b76/users/26a60c7ef97a46f0ad6516322baee2ea/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.533449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 780/1549] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.534981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539bc27-6404-4e81-b057-00f04461a9bf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.535399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539bc27-6404-4e81-b057-00f04461a9bf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.535777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539bc27-6404-4e81-b057-00f04461a9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.553562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43503f0-2f36-4476-8a4d-5f8a6245d68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adb2c2b14bf44a2bc20b453a2376b76, user_id=26a60c7ef97a46f0ad6516322baee2ea, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.557509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43503f0-2f36-4476-8a4d-5f8a6245d68c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.569344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7539bc27-6404-4e81-b057-00f04461a9bf None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.570604 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7539bc27-6404-4e81-b057-00f04461a9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.582940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 770/1550] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:53 2022] PUT /identity/v3/projects/6adb2c2b14bf44a2bc20b453a2376b76/users/26a60c7ef97a46f0ad6516322baee2ea/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:53.583795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43503f0-2f36-4476-8a4d-5f8a6245d68c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.585802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 781/1551] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.587382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea39c5-d9d4-4dba-bed0-3af7d20f6bc5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.587667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea39c5-d9d4-4dba-bed0-3af7d20f6bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.587938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea39c5-d9d4-4dba-bed0-3af7d20f6bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.607447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-efea39c5-d9d4-4dba-bed0-3af7d20f6bc5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.608639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-efea39c5-d9d4-4dba-bed0-3af7d20f6bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.654931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43503f0-2f36-4476-8a4d-5f8a6245d68c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.660324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694812b4-21dc-4c44-820b-5e3db5ab6efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:53.660931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694812b4-21dc-4c44-820b-5e3db5ab6efb admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.661213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694812b4-21dc-4c44-820b-5e3db5ab6efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.661492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694812b4-21dc-4c44-820b-5e3db5ab6efb admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.662191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694812b4-21dc-4c44-820b-5e3db5ab6efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:39:53.662474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694812b4-21dc-4c44-820b-5e3db5ab6efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.663502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING py.warnings [None req-694812b4-21dc-4c44-820b-5e3db5ab6efb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:39:53.663502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: warnings.warn(msg) Aug 26 15:39:53.663502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: Aug 26 15:39:53.664454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694812b4-21dc-4c44-820b-5e3db5ab6efb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.674149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 782/1552] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.675401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423e1f-e5a5-4951-a8b0-5f9c2f975f24 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.675689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423e1f-e5a5-4951-a8b0-5f9c2f975f24 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.675959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423e1f-e5a5-4951-a8b0-5f9c2f975f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.676795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 771/1553] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:39:53.677864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d846c-8318-441a-9592-74138199009f None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.678180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d846c-8318-441a-9592-74138199009f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.678474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d846c-8318-441a-9592-74138199009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.704098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-aa1d846c-8318-441a-9592-74138199009f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.704657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bd423e1f-e5a5-4951-a8b0-5f9c2f975f24 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.705319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-aa1d846c-8318-441a-9592-74138199009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.705833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bd423e1f-e5a5-4951-a8b0-5f9c2f975f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.713227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 772/1554] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.713951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 783/1555] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.715228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c160-f915-489f-9381-c61e265ad1f5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.715517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c160-f915-489f-9381-c61e265ad1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.715792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c160-f915-489f-9381-c61e265ad1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.717941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800a36-3999-42d5-a8be-b2c34ebe0312 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.718232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800a36-3999-42d5-a8be-b2c34ebe0312 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.718510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800a36-3999-42d5-a8be-b2c34ebe0312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.737905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1995c160-f915-489f-9381-c61e265ad1f5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.738699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-f6800a36-3999-42d5-a8be-b2c34ebe0312 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.739130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1995c160-f915-489f-9381-c61e265ad1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.740430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f6800a36-3999-42d5-a8be-b2c34ebe0312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.747466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 784/1556] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.748645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee16e55-304e-405b-9310-2396dd63a487 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.748925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee16e55-304e-405b-9310-2396dd63a487 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.749197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee16e55-304e-405b-9310-2396dd63a487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.754746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 773/1557] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.760182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af77909-130e-4f82-9521-1ae8d0e29d52 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.760470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af77909-130e-4f82-9521-1ae8d0e29d52 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.760749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af77909-130e-4f82-9521-1ae8d0e29d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.770138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0ee16e55-304e-405b-9310-2396dd63a487 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.771330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ee16e55-304e-405b-9310-2396dd63a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.779213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 785/1558] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.780386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f658c8-53dc-4ef6-adee-2982207ec8a4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.781452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f658c8-53dc-4ef6-adee-2982207ec8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.781452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f658c8-53dc-4ef6-adee-2982207ec8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.786105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:53.789335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8af77909-130e-4f82-9521-1ae8d0e29d52 None None] MFA Rules not processed for user `26a60c7ef97a46f0ad6516322baee2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.791116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8af77909-130e-4f82-9521-1ae8d0e29d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.801359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-20f658c8-53dc-4ef6-adee-2982207ec8a4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.802552 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-20f658c8-53dc-4ef6-adee-2982207ec8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.810261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 786/1559] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.811006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f658c8-53dc-4ef6-adee-2982207ec8a4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.821313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f658c8-53dc-4ef6-adee-2982207ec8a4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.826741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:53.827380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.828199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.828662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.829297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.830383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING py.warnings [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:39:53.830383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: warnings.warn(msg) Aug 26 15:39:53.830383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: Aug 26 15:39:53.831600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.837153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:53.861726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 787/1560] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:53.862611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.869667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 774/1561] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.869667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57f62-2896-4721-8819-508ac8b21b14 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.869667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57f62-2896-4721-8819-508ac8b21b14 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.869667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57f62-2896-4721-8819-508ac8b21b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.893241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-46b57f62-2896-4721-8819-508ac8b21b14 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.894483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-46b57f62-2896-4721-8819-508ac8b21b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.929872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd34e7-cabd-43bf-b018-613aebc3746c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.934456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e082e88-599c-46c5-a2e5-a2e347037e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:53.935068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082e88-599c-46c5-a2e5-a2e347037e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.935353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082e88-599c-46c5-a2e5-a2e347037e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.935637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e082e88-599c-46c5-a2e5-a2e347037e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.936286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e082e88-599c-46c5-a2e5-a2e347037e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:39:53.936593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e082e88-599c-46c5-a2e5-a2e347037e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:53.938795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e082e88-599c-46c5-a2e5-a2e347037e79 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:53.950310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 788/1562] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:39:53.951499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc49c6-9a53-46fe-b9fe-375e2d066f95 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.951785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc49c6-9a53-46fe-b9fe-375e2d066f95 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.952063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc49c6-9a53-46fe-b9fe-375e2d066f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.966156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 775/1563] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.967577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f58f9-97b7-40ac-9c4a-a95da9a87cc8 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:53.967859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f58f9-97b7-40ac-9c4a-a95da9a87cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:53.968140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f58f9-97b7-40ac-9c4a-a95da9a87cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:53.974189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e4dc49c6-9a53-46fe-b9fe-375e2d066f95 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.975404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e4dc49c6-9a53-46fe-b9fe-375e2d066f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.983344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 789/1564] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.984680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc49c6-9a53-46fe-b9fe-375e2d066f95 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:53.987784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-235f58f9-97b7-40ac-9c4a-a95da9a87cc8 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:53.988952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-235f58f9-97b7-40ac-9c4a-a95da9a87cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:53.994369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc49c6-9a53-46fe-b9fe-375e2d066f95 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:53.996832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 776/1565] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:53.996832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f58f9-97b7-40ac-9c4a-a95da9a87cc8 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.001642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.001642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.001642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.001642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.002013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:39:54.002013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.003250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.008144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f58f9-97b7-40ac-9c4a-a95da9a87cc8 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.013446 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5be8c8-1b4a-445e-b2bf-699e49276e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.014080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be8c8-1b4a-445e-b2bf-699e49276e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.014362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be8c8-1b4a-445e-b2bf-699e49276e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.014636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5be8c8-1b4a-445e-b2bf-699e49276e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.015621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 790/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:39:54.015807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5be8c8-1b4a-445e-b2bf-699e49276e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:39:54.016110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5be8c8-1b4a-445e-b2bf-699e49276e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.016468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.017705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5be8c8-1b4a-445e-b2bf-699e49276e71 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.027272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e3dc4-229f-42c1-8c04-c3f3e7c54849 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.029791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 777/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:39:54.031678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9b20b-3633-4941-bf6c-48df8d93db13 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.031994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9b20b-3633-4941-bf6c-48df8d93db13 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.032262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9b20b-3633-4941-bf6c-48df8d93db13 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.032980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b856d86-544c-4576-bc74-d7f9ac5ff0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.033581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b856d86-544c-4576-bc74-d7f9ac5ff0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.033867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 778/1568] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 26 15:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:39:54.034602 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9b20b-3633-4941-bf6c-48df8d93db13 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.038195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b856d86-544c-4576-bc74-d7f9ac5ff0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.038484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b856d86-544c-4576-bc74-d7f9ac5ff0cc admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.039180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b856d86-544c-4576-bc74-d7f9ac5ff0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.041095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b856d86-544c-4576-bc74-d7f9ac5ff0cc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.047668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9b20b-3633-4941-bf6c-48df8d93db13 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.053677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e810c-9d2a-409e-b4d9-22f0a13d7bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.054422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e810c-9d2a-409e-b4d9-22f0a13d7bce admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.054828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e810c-9d2a-409e-b4d9-22f0a13d7bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.055177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e810c-9d2a-409e-b4d9-22f0a13d7bce admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.055753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e810c-9d2a-409e-b4d9-22f0a13d7bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.057721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e810c-9d2a-409e-b4d9-22f0a13d7bce admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.067369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 791/1569] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.068284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b856d86-544c-4576-bc74-d7f9ac5ff0cc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.078775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b856d86-544c-4576-bc74-d7f9ac5ff0cc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.084726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.085349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.085627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.085926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.086569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:39:54.086871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.088464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.088923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 779/1570] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.089763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e810c-9d2a-409e-b4d9-22f0a13d7bce admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.107758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 792/1571] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:39:54.107758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.117761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5a900-3dc1-41d6-99b0-8f1e174bbc8b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.164295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e810c-9d2a-409e-b4d9-22f0a13d7bce admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.169079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.169690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.170026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.170306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.170975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:39:54.171314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.173135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.175772 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:54.176830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.177546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.177932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.178211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.178880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:39:54.179161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.180817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.186140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 780/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:39:54.187520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.193537 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 793/1573] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:39:54.194575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.199966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4afffd-323e-421a-a9bd-946df744ca8d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.205417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39f6cc-4f69-486e-9cb8-368418b3dcfb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.207266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e058df-b990-4389-a01f-9e31ebd88f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.207874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e058df-b990-4389-a01f-9e31ebd88f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.208156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e058df-b990-4389-a01f-9e31ebd88f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.208428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e058df-b990-4389-a01f-9e31ebd88f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.209075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e058df-b990-4389-a01f-9e31ebd88f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.210233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0007d5-82b6-42bc-bbde-b602af4886da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.210855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0007d5-82b6-42bc-bbde-b602af4886da admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.211004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e058df-b990-4389-a01f-9e31ebd88f81 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.211139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0007d5-82b6-42bc-bbde-b602af4886da admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.211403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0007d5-82b6-42bc-bbde-b602af4886da admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.212017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0007d5-82b6-42bc-bbde-b602af4886da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.213916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0007d5-82b6-42bc-bbde-b602af4886da admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.240678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 781/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.241974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cde17-543b-4437-9ff3-5b272f0580d2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.242269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cde17-543b-4437-9ff3-5b272f0580d2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.242536 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cde17-543b-4437-9ff3-5b272f0580d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.248494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 794/1575] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.250092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0007d5-82b6-42bc-bbde-b602af4886da admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.255757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:54.283726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-a74cde17-543b-4437-9ff3-5b272f0580d2 None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:54.284942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a74cde17-543b-4437-9ff3-5b272f0580d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:54.319119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0007d5-82b6-42bc-bbde-b602af4886da admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.323779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ed5e-48c0-4c73-9c74-b7b7b104432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.324383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ed5e-48c0-4c73-9c74-b7b7b104432c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.324669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ed5e-48c0-4c73-9c74-b7b7b104432c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.324941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ed5e-48c0-4c73-9c74-b7b7b104432c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.325582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ed5e-48c0-4c73-9c74-b7b7b104432c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.327228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ed5e-48c0-4c73-9c74-b7b7b104432c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.337505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 795/1576] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:54.338393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ed5e-48c0-4c73-9c74-b7b7b104432c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.348091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ed5e-48c0-4c73-9c74-b7b7b104432c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.352563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012073-a1c6-444b-be25-d4f823a32fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.352754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 782/1577] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:54.353214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012073-a1c6-444b-be25-d4f823a32fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.353503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012073-a1c6-444b-be25-d4f823a32fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.353632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cde17-543b-4437-9ff3-5b272f0580d2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.353805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012073-a1c6-444b-be25-d4f823a32fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.354491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66012073-a1c6-444b-be25-d4f823a32fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.356402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66012073-a1c6-444b-be25-d4f823a32fd5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.363921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cde17-543b-4437-9ff3-5b272f0580d2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.368804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2e3a6-afe8-4aa3-9308-73a5d77e0491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.369306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e3a6-afe8-4aa3-9308-73a5d77e0491 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.369637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e3a6-afe8-4aa3-9308-73a5d77e0491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.369883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e3a6-afe8-4aa3-9308-73a5d77e0491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.370562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2e3a6-afe8-4aa3-9308-73a5d77e0491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.372484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2e3a6-afe8-4aa3-9308-73a5d77e0491 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.383910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 796/1578] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.383910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012073-a1c6-444b-be25-d4f823a32fd5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.393938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012073-a1c6-444b-be25-d4f823a32fd5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.399233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad0ce6-d673-4f28-8173-8fb736d71128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.399835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad0ce6-d673-4f28-8173-8fb736d71128 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.400117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad0ce6-d673-4f28-8173-8fb736d71128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.400393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad0ce6-d673-4f28-8173-8fb736d71128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.401015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad0ce6-d673-4f28-8173-8fb736d71128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.402604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 783/1579] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.402956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad0ce6-d673-4f28-8173-8fb736d71128 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.403405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2e3a6-afe8-4aa3-9308-73a5d77e0491 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.431067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 797/1580] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.431808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad0ce6-d673-4f28-8173-8fb736d71128 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.468349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2e3a6-afe8-4aa3-9308-73a5d77e0491 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.494280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad0ce6-d673-4f28-8173-8fb736d71128 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.498911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03795663-b1ae-4895-b07d-02907121a0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.500062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795663-b1ae-4895-b07d-02907121a0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.500356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795663-b1ae-4895-b07d-02907121a0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.500596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03795663-b1ae-4895-b07d-02907121a0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.501271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795663-b1ae-4895-b07d-02907121a0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.503241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03795663-b1ae-4895-b07d-02907121a0d8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.503364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:54.527541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 798/1581] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.527541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03795663-b1ae-4895-b07d-02907121a0d8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.529564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a93a43-3400-4553-acd0-ada658f3bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.530236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93a43-3400-4553-acd0-ada658f3bb13 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.530518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93a43-3400-4553-acd0-ada658f3bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.530833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a93a43-3400-4553-acd0-ada658f3bb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.531575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a93a43-3400-4553-acd0-ada658f3bb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.533500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a93a43-3400-4553-acd0-ada658f3bb13 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.535239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03795663-b1ae-4895-b07d-02907121a0d8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.540665 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356bf2-dbdb-4b9a-b98c-1d4ec465fe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.541337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356bf2-dbdb-4b9a-b98c-1d4ec465fe76 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.541683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356bf2-dbdb-4b9a-b98c-1d4ec465fe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.542059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04356bf2-dbdb-4b9a-b98c-1d4ec465fe76 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.543329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04356bf2-dbdb-4b9a-b98c-1d4ec465fe76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.545246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04356bf2-dbdb-4b9a-b98c-1d4ec465fe76 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.561650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 784/1582] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/projects => generated 403 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.563311 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a93a43-3400-4553-acd0-ada658f3bb13 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.572056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 799/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.573290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356bf2-dbdb-4b9a-b98c-1d4ec465fe76 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.606647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:54.626665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a93a43-3400-4553-acd0-ada658f3bb13 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.631523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62b320-e9f3-47bd-9260-972a5d17ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.632136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62b320-e9f3-47bd-9260-972a5d17ec8b admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.632419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62b320-e9f3-47bd-9260-972a5d17ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.632695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62b320-e9f3-47bd-9260-972a5d17ec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.633342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62b320-e9f3-47bd-9260-972a5d17ec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.634985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62b320-e9f3-47bd-9260-972a5d17ec8b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.644906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 785/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:54.645713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62b320-e9f3-47bd-9260-972a5d17ec8b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.649239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04356bf2-dbdb-4b9a-b98c-1d4ec465fe76 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.655244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62b320-e9f3-47bd-9260-972a5d17ec8b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.660022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a966add-e78d-4af7-9afa-69cf743c6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.660599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a966add-e78d-4af7-9afa-69cf743c6ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.660884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a966add-e78d-4af7-9afa-69cf743c6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.661156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a966add-e78d-4af7-9afa-69cf743c6ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.661783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a966add-e78d-4af7-9afa-69cf743c6ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.663963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a966add-e78d-4af7-9afa-69cf743c6ce0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.674867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 786/1585] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:54.675958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a966add-e78d-4af7-9afa-69cf743c6ce0 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.685701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a966add-e78d-4af7-9afa-69cf743c6ce0 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.691639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.692283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.692561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.692831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.693438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.694535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING py.warnings [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:39:54.694535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: warnings.warn(msg) Aug 26 15:39:54.694535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: Aug 26 15:39:54.695720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.720544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 787/1586] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.720761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85581a42-5b03-4d5e-869c-fa2665350204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.720892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.721004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85581a42-5b03-4d5e-869c-fa2665350204 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.721004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85581a42-5b03-4d5e-869c-fa2665350204 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.721004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85581a42-5b03-4d5e-869c-fa2665350204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.728103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41162a02-a95c-4cad-923e-f7124b612c9d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.732783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bea15-418c-47a2-bc75-c16041f6fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.733366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bea15-418c-47a2-bc75-c16041f6fb36 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.733650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bea15-418c-47a2-bc75-c16041f6fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.734494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bea15-418c-47a2-bc75-c16041f6fb36 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.735114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bea15-418c-47a2-bc75-c16041f6fb36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.737038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bea15-418c-47a2-bc75-c16041f6fb36 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.759904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 788/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.760797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bea15-418c-47a2-bc75-c16041f6fb36 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.770996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bea15-418c-47a2-bc75-c16041f6fb36 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.775756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419af56-5ce9-4f80-926a-04de302d0648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.776433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419af56-5ce9-4f80-926a-04de302d0648 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.776713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419af56-5ce9-4f80-926a-04de302d0648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.777006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419af56-5ce9-4f80-926a-04de302d0648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.778053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419af56-5ce9-4f80-926a-04de302d0648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.779384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85581a42-5b03-4d5e-869c-fa2665350204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.779657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419af56-5ce9-4f80-926a-04de302d0648 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.781054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85581a42-5b03-4d5e-869c-fa2665350204 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.792826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 800/1588] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:54.792826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85581a42-5b03-4d5e-869c-fa2665350204 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.793593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 789/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:54.794635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419af56-5ce9-4f80-926a-04de302d0648 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.803396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85581a42-5b03-4d5e-869c-fa2665350204 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.805287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419af56-5ce9-4f80-926a-04de302d0648 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.808013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657f84-badb-448e-b29f-c6072c648cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.808606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657f84-badb-448e-b29f-c6072c648cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.808886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657f84-badb-448e-b29f-c6072c648cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.809164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657f84-badb-448e-b29f-c6072c648cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.809780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf657f84-badb-448e-b29f-c6072c648cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.810879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65749a-b216-4c8b-8608-9c7618c0c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.811643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65749a-b216-4c8b-8608-9c7618c0c238 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.811824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf657f84-badb-448e-b29f-c6072c648cb6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.812853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65749a-b216-4c8b-8608-9c7618c0c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.813376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65749a-b216-4c8b-8608-9c7618c0c238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.814196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65749a-b216-4c8b-8608-9c7618c0c238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.815923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65749a-b216-4c8b-8608-9c7618c0c238 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.826951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 790/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:54.828286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65749a-b216-4c8b-8608-9c7618c0c238 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.837498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 801/1591] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:54 2022] POST /identity/v3/users => generated 302 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:54.838528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657f84-badb-448e-b29f-c6072c648cb6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.843789 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65749a-b216-4c8b-8608-9c7618c0c238 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.849414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657f84-badb-448e-b29f-c6072c648cb6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.849690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ba2ee-8991-4ade-ba25-8e0029df4200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.850328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ba2ee-8991-4ade-ba25-8e0029df4200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.850627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ba2ee-8991-4ade-ba25-8e0029df4200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.850933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ba2ee-8991-4ade-ba25-8e0029df4200 admin admin] PATH_INFO: `/v3/projects/af9651358194459e92926965c4d4afe0/users/59499f8f98f9474c8eda196a712d752e/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.854331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068424-a639-44cf-9385-486cd141f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.855138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068424-a639-44cf-9385-486cd141f9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.855416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068424-a639-44cf-9385-486cd141f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.855694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068424-a639-44cf-9385-486cd141f9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.856361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068424-a639-44cf-9385-486cd141f9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.858017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068424-a639-44cf-9385-486cd141f9a8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.868661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ba2ee-8991-4ade-ba25-8e0029df4200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9651358194459e92926965c4d4afe0, user_id=59499f8f98f9474c8eda196a712d752e, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.868972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 802/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:54.872132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ba2ee-8991-4ade-ba25-8e0029df4200 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.872992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068424-a639-44cf-9385-486cd141f9a8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.883458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068424-a639-44cf-9385-486cd141f9a8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.888350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 791/1593] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:54 2022] PUT /identity/v3/projects/af9651358194459e92926965c4d4afe0/users/59499f8f98f9474c8eda196a712d752e/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:54.889351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ba2ee-8991-4ade-ba25-8e0029df4200 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.920336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:54.924329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:54.947154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30c29-5f7f-424a-8936-42cb82f28c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.947712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30c29-5f7f-424a-8936-42cb82f28c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.947959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30c29-5f7f-424a-8936-42cb82f28c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.948237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30c29-5f7f-424a-8936-42cb82f28c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.948872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30c29-5f7f-424a-8936-42cb82f28c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.950541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30c29-5f7f-424a-8936-42cb82f28c61 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.957999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ba2ee-8991-4ade-ba25-8e0029df4200 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.960875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 803/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:54.963003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30c29-5f7f-424a-8936-42cb82f28c61 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.963366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47950-be6d-4ccc-8cda-2d8eb2fd2b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.964478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47950-be6d-4ccc-8cda-2d8eb2fd2b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.964872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47950-be6d-4ccc-8cda-2d8eb2fd2b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.965242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d47950-be6d-4ccc-8cda-2d8eb2fd2b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.966022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d47950-be6d-4ccc-8cda-2d8eb2fd2b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.967724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d47950-be6d-4ccc-8cda-2d8eb2fd2b36 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.974529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30c29-5f7f-424a-8936-42cb82f28c61 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.978901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 792/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:54.979746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47950-be6d-4ccc-8cda-2d8eb2fd2b36 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:54.986239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8536-c353-4cbf-b704-887a43e25bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.987709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8536-c353-4cbf-b704-887a43e25bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.988394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8536-c353-4cbf-b704-887a43e25bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.989041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8536-c353-4cbf-b704-887a43e25bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.990506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d47950-be6d-4ccc-8cda-2d8eb2fd2b36 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:54.991201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e8536-c353-4cbf-b704-887a43e25bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.995281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acd95a-42fe-4ab9-b474-4a68749c1e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:54.995784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e8536-c353-4cbf-b704-887a43e25bd2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:54.995951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd95a-42fe-4ab9-b474-4a68749c1e67 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:54.996130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd95a-42fe-4ab9-b474-4a68749c1e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:54.996410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acd95a-42fe-4ab9-b474-4a68749c1e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:54.997039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acd95a-42fe-4ab9-b474-4a68749c1e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:54.998652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acd95a-42fe-4ab9-b474-4a68749c1e67 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.008667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 793/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:55.011157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 804/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:55.012616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acd95a-42fe-4ab9-b474-4a68749c1e67 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.013102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8536-c353-4cbf-b704-887a43e25bd2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.022910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acd95a-42fe-4ab9-b474-4a68749c1e67 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.024364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8536-c353-4cbf-b704-887a43e25bd2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.028744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b44fa9-20cd-4c30-b9e4-dbc9b6323170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.028995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.029557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44fa9-20cd-4c30-b9e4-dbc9b6323170 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.029666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.029933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.030159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44fa9-20cd-4c30-b9e4-dbc9b6323170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.030271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] PATH_INFO: `/v3/projects/cf1ce65bec0b4a3eb0d55a2b3821c540/users/c069cc5c93844445af5c514544e14a50/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.030607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b44fa9-20cd-4c30-b9e4-dbc9b6323170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.032097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b44fa9-20cd-4c30-b9e4-dbc9b6323170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.033941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b44fa9-20cd-4c30-b9e4-dbc9b6323170 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.048610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 794/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:55.048798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1ce65bec0b4a3eb0d55a2b3821c540, user_id=c069cc5c93844445af5c514544e14a50, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.048921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e9c1e-7107-4aa3-8ed0-ae4a25fdff2e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.048921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e9c1e-7107-4aa3-8ed0-ae4a25fdff2e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.048921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e9c1e-7107-4aa3-8ed0-ae4a25fdff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.049194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING py.warnings [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:39:55.049194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: warnings.warn(msg) Aug 26 15:39:55.049194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: Aug 26 15:39:55.050236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.063765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 805/1599] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:55 2022] PUT /identity/v3/projects/cf1ce65bec0b4a3eb0d55a2b3821c540/users/c069cc5c93844445af5c514544e14a50/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:55.064728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.067668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-bb8e9c1e-7107-4aa3-8ed0-ae4a25fdff2e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:55.068979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bb8e9c1e-7107-4aa3-8ed0-ae4a25fdff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:55.137923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 795/1600] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:55.138844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e9c1e-7107-4aa3-8ed0-ae4a25fdff2e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.144657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77879a68-a274-4c1a-97f4-967e35c6bc14 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.148623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e9c1e-7107-4aa3-8ed0-ae4a25fdff2e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.149408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4b4af-912a-4117-9e43-2a1505c0a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.150049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b4af-912a-4117-9e43-2a1505c0a6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.150327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b4af-912a-4117-9e43-2a1505c0a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.150594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b4af-912a-4117-9e43-2a1505c0a6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.151226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4b4af-912a-4117-9e43-2a1505c0a6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.152805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4b4af-912a-4117-9e43-2a1505c0a6a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.153129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0384-2aa2-4e2b-a952-9b2c89c5f306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.153725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0384-2aa2-4e2b-a952-9b2c89c5f306 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.154048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0384-2aa2-4e2b-a952-9b2c89c5f306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.154321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0384-2aa2-4e2b-a952-9b2c89c5f306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.154957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed0384-2aa2-4e2b-a952-9b2c89c5f306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.157120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed0384-2aa2-4e2b-a952-9b2c89c5f306 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.164001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 806/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:55.164849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4b4af-912a-4117-9e43-2a1505c0a6a0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.167734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 796/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:55.168458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0384-2aa2-4e2b-a952-9b2c89c5f306 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.177360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4b4af-912a-4117-9e43-2a1505c0a6a0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.178656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0384-2aa2-4e2b-a952-9b2c89c5f306 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.181867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37e2d2-ef1f-44ef-b896-a361c76f467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.182507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e2d2-ef1f-44ef-b896-a361c76f467c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.182788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e2d2-ef1f-44ef-b896-a361c76f467c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.183058 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37e2d2-ef1f-44ef-b896-a361c76f467c admin admin] PATH_INFO: `/v3/projects/73db84cca15f4534a2e4ad6c9c0b1e92/users/f6e294533c4d431f9cec66dddec33299/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.183233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1585621-c5d8-4209-8e35-2d49febd9de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.183866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585621-c5d8-4209-8e35-2d49febd9de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.184148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585621-c5d8-4209-8e35-2d49febd9de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.184422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585621-c5d8-4209-8e35-2d49febd9de7 admin admin] PATH_INFO: `/v3/projects/dfd9e207851e4e949941fc71c8fbecbe/users/ec3ef9ebbe2e4f30a811eef526bf9a86/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.197779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37e2d2-ef1f-44ef-b896-a361c76f467c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73db84cca15f4534a2e4ad6c9c0b1e92, user_id=f6e294533c4d431f9cec66dddec33299, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.200372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37e2d2-ef1f-44ef-b896-a361c76f467c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.200639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1585621-c5d8-4209-8e35-2d49febd9de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd9e207851e4e949941fc71c8fbecbe, user_id=ec3ef9ebbe2e4f30a811eef526bf9a86, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.203641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1585621-c5d8-4209-8e35-2d49febd9de7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.215578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 807/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:55 2022] PUT /identity/v3/projects/73db84cca15f4534a2e4ad6c9c0b1e92/users/f6e294533c4d431f9cec66dddec33299/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:55.216866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3671b-c0f5-4717-81e8-109566f57ec6 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.217155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3671b-c0f5-4717-81e8-109566f57ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.217429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3671b-c0f5-4717-81e8-109566f57ec6 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.219468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 808/1604] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 26 15:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:39:55.220199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3671b-c0f5-4717-81e8-109566f57ec6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.222883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 797/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:55 2022] PUT /identity/v3/projects/dfd9e207851e4e949941fc71c8fbecbe/users/ec3ef9ebbe2e4f30a811eef526bf9a86/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:55.224170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f27f5-235a-4644-852b-b1ac13d9aaa0 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.224481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f27f5-235a-4644-852b-b1ac13d9aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.224932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f27f5-235a-4644-852b-b1ac13d9aaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.253162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-215f27f5-235a-4644-852b-b1ac13d9aaa0 None None] MFA Rules not processed for user `c069cc5c93844445af5c514544e14a50`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:55.254402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-215f27f5-235a-4644-852b-b1ac13d9aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:55.294925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3671b-c0f5-4717-81e8-109566f57ec6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.302820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85d699-66f4-4f64-b2d0-b14578e22fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.303434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d699-66f4-4f64-b2d0-b14578e22fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.303715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d699-66f4-4f64-b2d0-b14578e22fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.304045 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d699-66f4-4f64-b2d0-b14578e22fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.304690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d699-66f4-4f64-b2d0-b14578e22fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.306360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85d699-66f4-4f64-b2d0-b14578e22fd5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.313647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:55.319799 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 809/1606] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:55.319799 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85d699-66f4-4f64-b2d0-b14578e22fd5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.327288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 798/1607] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:55.327288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f27f5-235a-4644-852b-b1ac13d9aaa0 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.333418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:55.336249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f27f5-235a-4644-852b-b1ac13d9aaa0 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.341088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3247-3484-42ae-ad8e-2d6455054f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.341766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3247-3484-42ae-ad8e-2d6455054f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.342579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3247-3484-42ae-ad8e-2d6455054f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.342579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3247-3484-42ae-ad8e-2d6455054f17 admin admin] PATH_INFO: `/v3/projects/7b0253439c5f43b79cb105e2c7a48684/users/725058b77fb64ed2a8a31869df3d2a27/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.363730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3247-3484-42ae-ad8e-2d6455054f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0253439c5f43b79cb105e2c7a48684, user_id=725058b77fb64ed2a8a31869df3d2a27, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.366564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3247-3484-42ae-ad8e-2d6455054f17 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.380454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 799/1608] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:55 2022] PUT /identity/v3/projects/7b0253439c5f43b79cb105e2c7a48684/users/725058b77fb64ed2a8a31869df3d2a27/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:55.381358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3247-3484-42ae-ad8e-2d6455054f17 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.393727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85d699-66f4-4f64-b2d0-b14578e22fd5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.441621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd5253-45c8-4b41-a316-9dda2069970b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.442258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd5253-45c8-4b41-a316-9dda2069970b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.442544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd5253-45c8-4b41-a316-9dda2069970b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.442817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd5253-45c8-4b41-a316-9dda2069970b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.444506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3247-3484-42ae-ad8e-2d6455054f17 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.449010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c1d28-c7aa-414f-ba1c-e7357982dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.449604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c1d28-c7aa-414f-ba1c-e7357982dde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.449901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c1d28-c7aa-414f-ba1c-e7357982dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.450177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c1d28-c7aa-414f-ba1c-e7357982dde3 admin admin] PATH_INFO: `/v3/projects/70868d9dd4584128b01e0c2213d2f885/users/2ab0d858a11e49cb877afebaf0971411/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.452050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd5253-45c8-4b41-a316-9dda2069970b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.454073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd5253-45c8-4b41-a316-9dda2069970b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.463453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 810/1609] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:55.464656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dfd6b-d095-4764-bdc6-bdaf88524b46 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.464940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dfd6b-d095-4764-bdc6-bdaf88524b46 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.465219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dfd6b-d095-4764-bdc6-bdaf88524b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.465918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c1d28-c7aa-414f-ba1c-e7357982dde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70868d9dd4584128b01e0c2213d2f885, user_id=2ab0d858a11e49cb877afebaf0971411, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.469556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c1d28-c7aa-414f-ba1c-e7357982dde3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.485487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-057dfd6b-d095-4764-bdc6-bdaf88524b46 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:55.486732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 800/1610] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:55 2022] PUT /identity/v3/projects/70868d9dd4584128b01e0c2213d2f885/users/2ab0d858a11e49cb877afebaf0971411/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:55.486857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-057dfd6b-d095-4764-bdc6-bdaf88524b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:55.487772 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506aa0f-b2ac-495f-b287-91323a2d8dd8 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.488057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506aa0f-b2ac-495f-b287-91323a2d8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.488344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506aa0f-b2ac-495f-b287-91323a2d8dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.510432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-7506aa0f-b2ac-495f-b287-91323a2d8dd8 None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:55.511640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7506aa0f-b2ac-495f-b287-91323a2d8dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:55.559447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 811/1611] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:55.560832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed32c4f-a25c-45a3-9fd8-57200bb2d028 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.561383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed32c4f-a25c-45a3-9fd8-57200bb2d028 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.561655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed32c4f-a25c-45a3-9fd8-57200bb2d028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.590323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 801/1612] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:55.591288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506aa0f-b2ac-495f-b287-91323a2d8dd8 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.600346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0ed32c4f-a25c-45a3-9fd8-57200bb2d028 None None] MFA Rules not processed for user `ec3ef9ebbe2e4f30a811eef526bf9a86`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:55.601751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ed32c4f-a25c-45a3-9fd8-57200bb2d028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:55.604013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506aa0f-b2ac-495f-b287-91323a2d8dd8 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.609553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8b060-c93a-4120-adf2-956b3258d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.610180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b060-c93a-4120-adf2-956b3258d255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.610459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b060-c93a-4120-adf2-956b3258d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.610731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b060-c93a-4120-adf2-956b3258d255 admin admin] PATH_INFO: `/v3/projects/5a8558da018848cfb53cd456e4050a8f/users/1dd2ba870604478cbbcc03405b5494c5/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.628463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8b060-c93a-4120-adf2-956b3258d255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8558da018848cfb53cd456e4050a8f, user_id=1dd2ba870604478cbbcc03405b5494c5, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.631350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8b060-c93a-4120-adf2-956b3258d255 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.648407 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 802/1613] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:55 2022] PUT /identity/v3/projects/5a8558da018848cfb53cd456e4050a8f/users/1dd2ba870604478cbbcc03405b5494c5/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:55.649606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7304b-d09d-42ca-a728-fa051ec4bd87 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.649997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7304b-d09d-42ca-a728-fa051ec4bd87 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.650346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7304b-d09d-42ca-a728-fa051ec4bd87 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.652095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 803/1614] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 26 15:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:39:55.653374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670d5a-6b25-4af3-aeb3-850d14a3b9a3 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.653495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670d5a-6b25-4af3-aeb3-850d14a3b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.653824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32670d5a-6b25-4af3-aeb3-850d14a3b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.676233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:55.679672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-32670d5a-6b25-4af3-aeb3-850d14a3b9a3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:55.681067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-32670d5a-6b25-4af3-aeb3-850d14a3b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:55.686875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 812/1615] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:55.688186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b13bec-3501-4667-bcd5-622a997be111 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.688473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b13bec-3501-4667-bcd5-622a997be111 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.688749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b13bec-3501-4667-bcd5-622a997be111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.704810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:55.717448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-74b13bec-3501-4667-bcd5-622a997be111 None None] MFA Rules not processed for user `2ab0d858a11e49cb877afebaf0971411`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:55.718861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74b13bec-3501-4667-bcd5-622a997be111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:55.765155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 804/1616] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:55.767068 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32670d5a-6b25-4af3-aeb3-850d14a3b9a3 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.807258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 813/1617] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:55.807996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b13bec-3501-4667-bcd5-622a997be111 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:55.843853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32670d5a-6b25-4af3-aeb3-850d14a3b9a3 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.848955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5f051-3c6a-4399-bacf-5baa08acad3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.849723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f051-3c6a-4399-bacf-5baa08acad3a service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.850037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f051-3c6a-4399-bacf-5baa08acad3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.850310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5f051-3c6a-4399-bacf-5baa08acad3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.867686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5f051-3c6a-4399-bacf-5baa08acad3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:55.869271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5f051-3c6a-4399-bacf-5baa08acad3a service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:55.881015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 805/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:55.882127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be1c7-7d2a-45bd-a748-dfcb9b73c4df None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.882402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be1c7-7d2a-45bd-a748-dfcb9b73c4df None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.882677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1be1c7-7d2a-45bd-a748-dfcb9b73c4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.899772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b13bec-3501-4667-bcd5-622a997be111 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:55.903689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f78f0-068b-428c-beb5-721978e469ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:55.904396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f78f0-068b-428c-beb5-721978e469ec service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.904735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f78f0-068b-428c-beb5-721978e469ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.906352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f78f0-068b-428c-beb5-721978e469ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:55.914770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-9d1be1c7-7d2a-45bd-a748-dfcb9b73c4df None None] MFA Rules not processed for user `1dd2ba870604478cbbcc03405b5494c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:55.915998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9d1be1c7-7d2a-45bd-a748-dfcb9b73c4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:55.998696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 806/1619] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:55.998696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b2b9-4f2e-49bc-a615-94decf77f0f9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:55.998696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b2b9-4f2e-49bc-a615-94decf77f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:55.998696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b2b9-4f2e-49bc-a615-94decf77f0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.004335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f78f0-068b-428c-beb5-721978e469ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.005947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f78f0-068b-428c-beb5-721978e469ec service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.017665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-67d8b2b9-4f2e-49bc-a615-94decf77f0f9 None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:56.018339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 814/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:56.018917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-67d8b2b9-4f2e-49bc-a615-94decf77f0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:56.019041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f78f0-068b-428c-beb5-721978e469ec service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.029754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f78f0-068b-428c-beb5-721978e469ec service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.031730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 807/1621] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 26 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:56.032765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b2b9-4f2e-49bc-a615-94decf77f0f9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.035569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb975f0-4f45-48b5-b3cd-f350adce7d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.036235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb975f0-4f45-48b5-b3cd-f350adce7d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.036518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb975f0-4f45-48b5-b3cd-f350adce7d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.036792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb975f0-4f45-48b5-b3cd-f350adce7d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.037420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb975f0-4f45-48b5-b3cd-f350adce7d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.039629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb975f0-4f45-48b5-b3cd-f350adce7d17 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.045711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b2b9-4f2e-49bc-a615-94decf77f0f9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.051534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172617-e666-4f27-acab-6f2d131a5c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.052002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172617-e666-4f27-acab-6f2d131a5c6a service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.052287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172617-e666-4f27-acab-6f2d131a5c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.052698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172617-e666-4f27-acab-6f2d131a5c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.064605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f172617-e666-4f27-acab-6f2d131a5c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.066296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f172617-e666-4f27-acab-6f2d131a5c6a service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.074510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 815/1622] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:56 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:56.075630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb975f0-4f45-48b5-b3cd-f350adce7d17 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.079339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 808/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:56.080178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172617-e666-4f27-acab-6f2d131a5c6a service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.082476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:56.092121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172617-e666-4f27-acab-6f2d131a5c6a service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.135666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:56.181298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb975f0-4f45-48b5-b3cd-f350adce7d17 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.182901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d902c4-c02e-47d2-a57e-f7c503fd12da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.183723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d902c4-c02e-47d2-a57e-f7c503fd12da admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.184107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d902c4-c02e-47d2-a57e-f7c503fd12da admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.184539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d902c4-c02e-47d2-a57e-f7c503fd12da admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.185373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d902c4-c02e-47d2-a57e-f7c503fd12da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.185964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f5a99-8a67-4dc0-b6a8-6a914654dae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.186590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f5a99-8a67-4dc0-b6a8-6a914654dae8 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.186902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f5a99-8a67-4dc0-b6a8-6a914654dae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.187572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f5a99-8a67-4dc0-b6a8-6a914654dae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.188304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d902c4-c02e-47d2-a57e-f7c503fd12da admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.233412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 809/1624] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:39:56 2022] POST /identity/v3/projects => generated 403 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:56.233412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d902c4-c02e-47d2-a57e-f7c503fd12da admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.263587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f5a99-8a67-4dc0-b6a8-6a914654dae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.266214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f5a99-8a67-4dc0-b6a8-6a914654dae8 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.285758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 816/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:56.288124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f5a99-8a67-4dc0-b6a8-6a914654dae8 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.311428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f5a99-8a67-4dc0-b6a8-6a914654dae8 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.389882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d902c4-c02e-47d2-a57e-f7c503fd12da admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.411825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1f55-ba20-4e74-b7e9-292884a44bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.412098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990882db-6488-4d47-95f4-dfddfd29b934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.412466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990882db-6488-4d47-95f4-dfddfd29b934 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.412771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990882db-6488-4d47-95f4-dfddfd29b934 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.412894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1f55-ba20-4e74-b7e9-292884a44bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.413067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990882db-6488-4d47-95f4-dfddfd29b934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.413169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1f55-ba20-4e74-b7e9-292884a44bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.413416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1f55-ba20-4e74-b7e9-292884a44bdd admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.414251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d1f55-ba20-4e74-b7e9-292884a44bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.416205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d1f55-ba20-4e74-b7e9-292884a44bdd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.488289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 817/1626] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:56 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:56.496943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1f55-ba20-4e74-b7e9-292884a44bdd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.535584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1f55-ba20-4e74-b7e9-292884a44bdd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.551838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c8740-4e8b-4653-ad75-b90f336bdb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.553217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c8740-4e8b-4653-ad75-b90f336bdb9a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.553723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c8740-4e8b-4653-ad75-b90f336bdb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.554936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c8740-4e8b-4653-ad75-b90f336bdb9a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.558160 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c8740-4e8b-4653-ad75-b90f336bdb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.563893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c8740-4e8b-4653-ad75-b90f336bdb9a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.592091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990882db-6488-4d47-95f4-dfddfd29b934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.595003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990882db-6488-4d47-95f4-dfddfd29b934 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.617915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 818/1627] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:39:56 2022] POST /identity/v3/users => generated 308 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:39:56.618911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c8740-4e8b-4653-ad75-b90f336bdb9a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.625422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 810/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:56.626654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990882db-6488-4d47-95f4-dfddfd29b934 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.641726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c8740-4e8b-4653-ad75-b90f336bdb9a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.655226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990882db-6488-4d47-95f4-dfddfd29b934 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.656105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31867d0-a404-4e95-9648-7add131f17fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.657312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31867d0-a404-4e95-9648-7add131f17fa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.658338 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31867d0-a404-4e95-9648-7add131f17fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.660125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31867d0-a404-4e95-9648-7add131f17fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.661782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31867d0-a404-4e95-9648-7add131f17fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.666971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31867d0-a404-4e95-9648-7add131f17fa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.670747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c60f14-efc2-45e6-b01c-9b8398bda396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.671867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60f14-efc2-45e6-b01c-9b8398bda396 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.672167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60f14-efc2-45e6-b01c-9b8398bda396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.672487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60f14-efc2-45e6-b01c-9b8398bda396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.675025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60f14-efc2-45e6-b01c-9b8398bda396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.676855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60f14-efc2-45e6-b01c-9b8398bda396 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.694683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 819/1629] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:56.700475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31867d0-a404-4e95-9648-7add131f17fa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.712766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 811/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:56.714214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c60f14-efc2-45e6-b01c-9b8398bda396 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.733742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31867d0-a404-4e95-9648-7add131f17fa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.734021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c60f14-efc2-45e6-b01c-9b8398bda396 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:56.742647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea867218-92e4-4386-a7b7-78b9fd5ad4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.743336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea867218-92e4-4386-a7b7-78b9fd5ad4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.743736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea867218-92e4-4386-a7b7-78b9fd5ad4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.744021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea867218-92e4-4386-a7b7-78b9fd5ad4f4 admin admin] PATH_INFO: `/v3/projects/94b4fb57e3ef49cd932f7909217789cb/users/7d37673f6c664a07b124eb83b1b52c42/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.755084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074d2b-d7e1-4d4b-b3d0-99ee26003a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:56.755946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d2b-d7e1-4d4b-b3d0-99ee26003a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:56.756136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d2b-d7e1-4d4b-b3d0-99ee26003a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:56.756416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5074d2b-d7e1-4d4b-b3d0-99ee26003a2d admin admin] PATH_INFO: `/v3/projects/e41432bf6d6f4f34b37598b1e0772c54/users/827de488ca6545b2a00a559d0a2e7468/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:56.775385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea867218-92e4-4386-a7b7-78b9fd5ad4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b4fb57e3ef49cd932f7909217789cb, user_id=7d37673f6c664a07b124eb83b1b52c42, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.785484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea867218-92e4-4386-a7b7-78b9fd5ad4f4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.798056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5074d2b-d7e1-4d4b-b3d0-99ee26003a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41432bf6d6f4f34b37598b1e0772c54, user_id=827de488ca6545b2a00a559d0a2e7468, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:56.800952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5074d2b-d7e1-4d4b-b3d0-99ee26003a2d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:56.811730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:56.845263 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 820/1631] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:56 2022] PUT /identity/v3/projects/e41432bf6d6f4f34b37598b1e0772c54/users/827de488ca6545b2a00a559d0a2e7468/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:56.846267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074d2b-d7e1-4d4b-b3d0-99ee26003a2d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.861443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 812/1632] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:56 2022] PUT /identity/v3/projects/94b4fb57e3ef49cd932f7909217789cb/users/7d37673f6c664a07b124eb83b1b52c42/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:56.865670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea867218-92e4-4386-a7b7-78b9fd5ad4f4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:56.936969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:57.057288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5074d2b-d7e1-4d4b-b3d0-99ee26003a2d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:57.079952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200f5bf-35c3-4ed1-b128-42753b554542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:57.080351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea867218-92e4-4386-a7b7-78b9fd5ad4f4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:57.080968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200f5bf-35c3-4ed1-b128-42753b554542 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.080968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200f5bf-35c3-4ed1-b128-42753b554542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.081770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200f5bf-35c3-4ed1-b128-42753b554542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.091987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200f5bf-35c3-4ed1-b128-42753b554542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:57.100673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200f5bf-35c3-4ed1-b128-42753b554542 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:57.103638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b1c80-5864-424d-93e8-6500a3938d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:57.106278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b1c80-5864-424d-93e8-6500a3938d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.116367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b1c80-5864-424d-93e8-6500a3938d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.116923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b1c80-5864-424d-93e8-6500a3938d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.128654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b1c80-5864-424d-93e8-6500a3938d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:57.135722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 821/1633] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:57.136438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b1c80-5864-424d-93e8-6500a3938d41 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:57.150685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200f5bf-35c3-4ed1-b128-42753b554542 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:57.172707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 813/1634] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:39:57.177550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b1c80-5864-424d-93e8-6500a3938d41 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:57.178453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200f5bf-35c3-4ed1-b128-42753b554542 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:57.197251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b1c80-5864-424d-93e8-6500a3938d41 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:57.203621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1186503-8379-4be1-95ca-c0d473292251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:57.204309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1186503-8379-4be1-95ca-c0d473292251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.204700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1186503-8379-4be1-95ca-c0d473292251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.204989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1186503-8379-4be1-95ca-c0d473292251 admin admin] PATH_INFO: `/v3/projects/e41432bf6d6f4f34b37598b1e0772c54/users/827de488ca6545b2a00a559d0a2e7468/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.209892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1186503-8379-4be1-95ca-c0d473292251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41432bf6d6f4f34b37598b1e0772c54, user_id=827de488ca6545b2a00a559d0a2e7468, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:57.212598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1186503-8379-4be1-95ca-c0d473292251 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:57.217023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bbf30-aa87-4aa0-9e99-e19a6b272616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:57.217876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbf30-aa87-4aa0-9e99-e19a6b272616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.217876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbf30-aa87-4aa0-9e99-e19a6b272616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.218175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bbf30-aa87-4aa0-9e99-e19a6b272616 admin admin] PATH_INFO: `/v3/projects/94b4fb57e3ef49cd932f7909217789cb/users/7d37673f6c664a07b124eb83b1b52c42/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.220668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bbf30-aa87-4aa0-9e99-e19a6b272616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b4fb57e3ef49cd932f7909217789cb, user_id=7d37673f6c664a07b124eb83b1b52c42, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:57.223347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bbf30-aa87-4aa0-9e99-e19a6b272616 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:57.248216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 814/1635] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:57 2022] PUT /identity/v3/projects/94b4fb57e3ef49cd932f7909217789cb/users/7d37673f6c664a07b124eb83b1b52c42/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:39:57.260780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 822/1636] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:39:57 2022] PUT /identity/v3/projects/e41432bf6d6f4f34b37598b1e0772c54/users/827de488ca6545b2a00a559d0a2e7468/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:39:57.260982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5cb97-4595-4e53-b5e4-977917690c94 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.261080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5cb97-4595-4e53-b5e4-977917690c94 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.261310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5cb97-4595-4e53-b5e4-977917690c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.283131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d40443-d154-4b98-a788-86c3fc81ef1c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.283442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d40443-d154-4b98-a788-86c3fc81ef1c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.286184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d40443-d154-4b98-a788-86c3fc81ef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.317984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b2f5cb97-4595-4e53-b5e4-977917690c94 None None] MFA Rules not processed for user `7d37673f6c664a07b124eb83b1b52c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:57.319553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b2f5cb97-4595-4e53-b5e4-977917690c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:57.350656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-20d40443-d154-4b98-a788-86c3fc81ef1c None None] MFA Rules not processed for user `827de488ca6545b2a00a559d0a2e7468`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:57.351523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-20d40443-d154-4b98-a788-86c3fc81ef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:57.541034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 815/1637] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:57.553441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5cb97-4595-4e53-b5e4-977917690c94 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:57.577379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 823/1638] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:57.620802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d40443-d154-4b98-a788-86c3fc81ef1c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:57.720505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5cb97-4595-4e53-b5e4-977917690c94 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:57.734167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bfcc4-2825-4804-858d-bb02d1c8d6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:57.735550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bfcc4-2825-4804-858d-bb02d1c8d6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.737524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bfcc4-2825-4804-858d-bb02d1c8d6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.738285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bfcc4-2825-4804-858d-bb02d1c8d6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.762114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bfcc4-2825-4804-858d-bb02d1c8d6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:57.764636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bfcc4-2825-4804-858d-bb02d1c8d6c5 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:57.792097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 816/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:57 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:39:57.797371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a817-56a1-4f88-8c16-335c018657f7 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.799268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a817-56a1-4f88-8c16-335c018657f7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.799798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a817-56a1-4f88-8c16-335c018657f7 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.806338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 817/1640] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 26 15:39:57 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:39:57.817218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69511e43-ecf4-48f2-aa55-b13b1e965ca9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.817460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69511e43-ecf4-48f2-aa55-b13b1e965ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.817560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69511e43-ecf4-48f2-aa55-b13b1e965ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.820754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d40443-d154-4b98-a788-86c3fc81ef1c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:57.830683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bd27e-4323-4587-81e5-31abd72cf800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:57.831719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bd27e-4323-4587-81e5-31abd72cf800 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:57.832216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bd27e-4323-4587-81e5-31abd72cf800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:57.833567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bd27e-4323-4587-81e5-31abd72cf800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:57.862926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-69511e43-ecf4-48f2-aa55-b13b1e965ca9 None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:57.864173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-69511e43-ecf4-48f2-aa55-b13b1e965ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:57.882876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bd27e-4323-4587-81e5-31abd72cf800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:57.884354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bd27e-4323-4587-81e5-31abd72cf800 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:57.924718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 824/1641] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:39:57.958769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:58.053123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bd27e-4323-4587-81e5-31abd72cf800 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:58.069873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 818/1642] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:39:58.070717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bd27e-4323-4587-81e5-31abd72cf800 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:58.075870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7afa58-86a7-4260-84dd-dea45dd7ed35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:58.076878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7afa58-86a7-4260-84dd-dea45dd7ed35 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:58.077394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7afa58-86a7-4260-84dd-dea45dd7ed35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:58.078730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7afa58-86a7-4260-84dd-dea45dd7ed35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:58.084442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:58.099115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69511e43-ecf4-48f2-aa55-b13b1e965ca9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:58.151497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7afa58-86a7-4260-84dd-dea45dd7ed35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:58.153580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7afa58-86a7-4260-84dd-dea45dd7ed35 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:58.179874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 825/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:39:58.182230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7afa58-86a7-4260-84dd-dea45dd7ed35 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:58.216293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7afa58-86a7-4260-84dd-dea45dd7ed35 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:58.232955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99e3d-4a64-4b49-a945-c86d1c167abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:58.235778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99e3d-4a64-4b49-a945-c86d1c167abf service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:58.237454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99e3d-4a64-4b49-a945-c86d1c167abf service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:58.238024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99e3d-4a64-4b49-a945-c86d1c167abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:58.244046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69511e43-ecf4-48f2-aa55-b13b1e965ca9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:58.252729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:58.253867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:58.254582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:58.254867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] PATH_INFO: `/v3/users/1dd2ba870604478cbbcc03405b5494c5` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:58.256106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd2ba870604478cbbcc03405b5494c5)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:58.258170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:58.280666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b99e3d-4a64-4b49-a945-c86d1c167abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:58.284468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b99e3d-4a64-4b49-a945-c86d1c167abf service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:58.324023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 826/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:58.365824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd2ba870604478cbbcc03405b5494c5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:58.366642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd2ba870604478cbbcc03405b5494c5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:58.416207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd2ba870604478cbbcc03405b5494c5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:58.435145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd2ba870604478cbbcc03405b5494c5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:58.436078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd2ba870604478cbbcc03405b5494c5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:58.462314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 819/1645] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:39:58 2022] DELETE /identity/v3/users/1dd2ba870604478cbbcc03405b5494c5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:39:58.467656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532a563-d04a-4442-8f0f-3820302285ae None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:58.467945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532a563-d04a-4442-8f0f-3820302285ae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:58.469212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532a563-d04a-4442-8f0f-3820302285ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:58.529524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3532a563-d04a-4442-8f0f-3820302285ae None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:58.531399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3532a563-d04a-4442-8f0f-3820302285ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:58.574416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:58.576139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:58.732679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:58.801604 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 827/1646] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:58.823401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fa0cb-fb6f-4087-a9c9-ba78e2976d75 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:58.837388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:58.840003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:58.840942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:58.842058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] PATH_INFO: `/v3/users/c069cc5c93844445af5c514544e14a50` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:58.845028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c069cc5c93844445af5c514544e14a50)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:58.848946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:58.858943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532a563-d04a-4442-8f0f-3820302285ae None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:58.860582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3532a563-d04a-4442-8f0f-3820302285ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:58.995083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c069cc5c93844445af5c514544e14a50'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:58.996150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c069cc5c93844445af5c514544e14a50'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:59.022119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532a563-d04a-4442-8f0f-3820302285ae None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:59.025559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c069cc5c93844445af5c514544e14a50'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:59.033392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:59.035995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:59.036647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:59.037204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:59.041188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:59.044642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c069cc5c93844445af5c514544e14a50'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:59.048007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-66af9662-58df-4026-95e6-af8cba9ed177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c069cc5c93844445af5c514544e14a50'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:39:59.075444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:59.076327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 820/1647] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:39:58 2022] DELETE /identity/v3/users/c069cc5c93844445af5c514544e14a50 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:39:59.080231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:59.083486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489d4e-db7a-4b39-ae40-7ee69b543d28 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:59.084292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489d4e-db7a-4b39-ae40-7ee69b543d28 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:59.084866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489d4e-db7a-4b39-ae40-7ee69b543d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:59.139286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8b489d4e-db7a-4b39-ae40-7ee69b543d28 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:39:59.139854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 828/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:39:59.143214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8b489d4e-db7a-4b39-ae40-7ee69b543d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:59.334630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 821/1649] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:39:59.379893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:39:59.382596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:39:59.402445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1190a-3a45-4694-9e35-4bec3722c4a5 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:39:59.514434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:39:59.557526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:39:59.564902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:39:59.564902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:39:59.564902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:39:59.602083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:39:59.603574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:39:59.636813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 829/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:00.685768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b489d4e-db7a-4b39-ae40-7ee69b543d28 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:00.688667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8b489d4e-db7a-4b39-ae40-7ee69b543d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:00.718823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b489d4e-db7a-4b39-ae40-7ee69b543d28 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:00.746187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:00.757197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:00.757697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:00.758214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] PATH_INFO: `/v3/projects/cf1ce65bec0b4a3eb0d55a2b3821c540` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:00.760596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1ce65bec0b4a3eb0d55a2b3821c540)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:00.762242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: WARNING py.warnings [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:40:00.762242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: warnings.warn(msg) Aug 26 15:40:00.762242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: Aug 26 15:40:00.764299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:00.780776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:00.782921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:00.815804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94cbfe-f02c-4a96-be02-5a82495e1abc service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:00.844098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:00.845680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:00.845987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:00.846264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] PATH_INFO: `/v3/projects/5a8558da018848cfb53cd456e4050a8f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:00.848409 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8558da018848cfb53cd456e4050a8f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:00.850404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:00.977870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1ce65bec0b4a3eb0d55a2b3821c540', 'request_id': 'req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:00.984762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1ce65bec0b4a3eb0d55a2b3821c540', 'request_id': 'req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:00.987925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:01.017353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8558da018848cfb53cd456e4050a8f', 'request_id': 'req-ecfc7924-05f4-4d26-b754-c25c9a31baa4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.025761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1ce65bec0b4a3eb0d55a2b3821c540', 'request_id': 'req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.042677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8558da018848cfb53cd456e4050a8f', 'request_id': 'req-ecfc7924-05f4-4d26-b754-c25c9a31baa4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.056273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8558da018848cfb53cd456e4050a8f', 'request_id': 'req-ecfc7924-05f4-4d26-b754-c25c9a31baa4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.081545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] The token cache is being invalidate because project cf1ce65bec0b4a3eb0d55a2b3821c540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:01.081889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.088293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-414c9a3b-2b9a-4aaf-ac26-47233dcf6f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.090088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 822/1651] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:00 2022] DELETE /identity/v3/projects/cf1ce65bec0b4a3eb0d55a2b3821c540 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:01.095033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] The token cache is being invalidate because project 5a8558da018848cfb53cd456e4050a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:01.096637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af94c-9197-40ce-91af-837899541ea1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:01.097088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.098154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af94c-9197-40ce-91af-837899541ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:01.098607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.100374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8af94c-9197-40ce-91af-837899541ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:01.103194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 830/1652] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:00 2022] DELETE /identity/v3/projects/5a8558da018848cfb53cd456e4050a8f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:01.108182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:01.114085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:01.178561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3e8af94c-9197-40ce-91af-837899541ea1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:01.187941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3e8af94c-9197-40ce-91af-837899541ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:01.307539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc7924-05f4-4d26-b754-c25c9a31baa4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:01.326310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:01.327124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:01.333974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:01.333974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] PATH_INFO: `/v3/users/7d37673f6c664a07b124eb83b1b52c42` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:01.334234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 823/1653] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:01.338252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d37673f6c664a07b124eb83b1b52c42)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:01.348274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: WARNING py.warnings [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:40:01.348274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: warnings.warn(msg) Aug 26 15:40:01.348274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: Aug 26 15:40:01.348971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609fe5-e812-4323-964f-0b8c66b25cb3 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:01.350525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609fe5-e812-4323-964f-0b8c66b25cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:01.351548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609fe5-e812-4323-964f-0b8c66b25cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:01.354955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:01.417633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-51609fe5-e812-4323-964f-0b8c66b25cb3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:01.421928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-51609fe5-e812-4323-964f-0b8c66b25cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:01.452757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 824/1654] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:01.455914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51609fe5-e812-4323-964f-0b8c66b25cb3 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:01.482136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51609fe5-e812-4323-964f-0b8c66b25cb3 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:01.500489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:01.502553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:01.504052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:01.504363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:01.507280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:01.510172 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:01.519234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:01.570944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 825/1655] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:01.576101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:01.599094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399fa5f-4a74-4a18-a8ec-13ed33882404 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:01.612531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d37673f6c664a07b124eb83b1b52c42'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.615098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d37673f6c664a07b124eb83b1b52c42'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.615372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:01.616013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:01.616296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:01.616566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:01.617207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:01.619225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:01.692786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:01.697577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d37673f6c664a07b124eb83b1b52c42'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.723878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d37673f6c664a07b124eb83b1b52c42'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.724884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d37673f6c664a07b124eb83b1b52c42'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:01.726453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 826/1656] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:01 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:01.732561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:01.736853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:01.803197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 831/1657] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:01 2022] DELETE /identity/v3/users/7d37673f6c664a07b124eb83b1b52c42 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:01.975422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27d4b0-9c5b-437b-9dd4-f395a9413e13 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:02.158682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:02.184509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9747b2-f5a1-410c-9dfb-04e7def4bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:02.185993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9747b2-f5a1-410c-9dfb-04e7def4bdcd admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:02.186711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9747b2-f5a1-410c-9dfb-04e7def4bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:02.187829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9747b2-f5a1-410c-9dfb-04e7def4bdcd admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:02.189599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9747b2-f5a1-410c-9dfb-04e7def4bdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:02.210992 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9747b2-f5a1-410c-9dfb-04e7def4bdcd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:02.283215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 827/1658] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:01 2022] POST /identity/v3/users => generated 303 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:02.287738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:02.301532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42048faa-368e-459b-accc-b3db63c59ee6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:02.308734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5c5d4-9982-4713-a473-acbd5b5aefab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:02.309592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c5d4-9982-4713-a473-acbd5b5aefab admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:02.310981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c5d4-9982-4713-a473-acbd5b5aefab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:02.311540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c5d4-9982-4713-a473-acbd5b5aefab admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:02.314651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5c5d4-9982-4713-a473-acbd5b5aefab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:02.322187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5c5d4-9982-4713-a473-acbd5b5aefab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:02.379595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 832/1659] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:02.384776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9747b2-f5a1-410c-9dfb-04e7def4bdcd admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:02.400507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9747b2-f5a1-410c-9dfb-04e7def4bdcd admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:02.434453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a45ab-bbb3-4a2c-a819-c2b7e75973c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:02.435963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a45ab-bbb3-4a2c-a819-c2b7e75973c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:02.437688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a45ab-bbb3-4a2c-a819-c2b7e75973c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:02.438149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a45ab-bbb3-4a2c-a819-c2b7e75973c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:02.439189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a45ab-bbb3-4a2c-a819-c2b7e75973c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:02.445157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a45ab-bbb3-4a2c-a819-c2b7e75973c0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:02.480421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 828/1660] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:02.481211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5c5d4-9982-4713-a473-acbd5b5aefab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:02.497800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5c5d4-9982-4713-a473-acbd5b5aefab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:02.513759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:02.517772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:02.518227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:02.518723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] PATH_INFO: `/v3/projects/947efed5669c4c4a844b0d272a126fd1/users/ff4c71e4dd264c78840f600673d63d9d/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:02.597651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947efed5669c4c4a844b0d272a126fd1, user_id=ff4c71e4dd264c78840f600673d63d9d, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:02.605980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:02.649804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 833/1661] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:02 2022] PUT /identity/v3/projects/947efed5669c4c4a844b0d272a126fd1/users/ff4c71e4dd264c78840f600673d63d9d/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:02.666447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86876a-c7f5-4f04-b1e0-61d0104c99e1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:02.672004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86876a-c7f5-4f04-b1e0-61d0104c99e1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:02.674871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86876a-c7f5-4f04-b1e0-61d0104c99e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:02.721797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8a86876a-c7f5-4f04-b1e0-61d0104c99e1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:02.723164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8a86876a-c7f5-4f04-b1e0-61d0104c99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:02.924569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 829/1662] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:02.969331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:02.972055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:03.055353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61b91a-8557-4cca-8624-d0710adc7de1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:03.064365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4bfa8-4b7b-47b4-ae9d-a8e6efbb5fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:03.066381 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4bfa8-4b7b-47b4-ae9d-a8e6efbb5fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:03.066996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4bfa8-4b7b-47b4-ae9d-a8e6efbb5fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:03.067465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4bfa8-4b7b-47b4-ae9d-a8e6efbb5fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:03.095668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4bfa8-4b7b-47b4-ae9d-a8e6efbb5fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:03.100146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4bfa8-4b7b-47b4-ae9d-a8e6efbb5fc3 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:03.145266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 834/1663] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:04.036558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86876a-c7f5-4f04-b1e0-61d0104c99e1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:04.038283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8a86876a-c7f5-4f04-b1e0-61d0104c99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:04.058008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86876a-c7f5-4f04-b1e0-61d0104c99e1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:04.063591 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:04.064523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:04.065003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:04.065719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] PATH_INFO: `/v3/users/26a60c7ef97a46f0ad6516322baee2ea` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:04.067895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a60c7ef97a46f0ad6516322baee2ea)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:04.070158 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:04.146317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a60c7ef97a46f0ad6516322baee2ea'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:04.147271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a60c7ef97a46f0ad6516322baee2ea'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:04.190147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a60c7ef97a46f0ad6516322baee2ea'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:04.211802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a60c7ef97a46f0ad6516322baee2ea'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:04.212583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a60c7ef97a46f0ad6516322baee2ea'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:04.242383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 830/1664] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:04 2022] DELETE /identity/v3/users/26a60c7ef97a46f0ad6516322baee2ea => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:04.243636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1daa33-5710-44b4-b685-eb063d27331f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:04.244083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1daa33-5710-44b4-b685-eb063d27331f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:04.244925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1daa33-5710-44b4-b685-eb063d27331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:04.283130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8f1daa33-5710-44b4-b685-eb063d27331f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:04.284384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f1daa33-5710-44b4-b685-eb063d27331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:04.451645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 835/1665] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:04.516492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:04.518175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:04.712325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:04.733128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d39f3-3d0f-4e03-bec6-6bf0fe5a58fd admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:04.748051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120af6d-6381-4b52-8055-b5ad0e7fe943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:04.750321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120af6d-6381-4b52-8055-b5ad0e7fe943 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:04.750870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120af6d-6381-4b52-8055-b5ad0e7fe943 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:04.751507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120af6d-6381-4b52-8055-b5ad0e7fe943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:04.795208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120af6d-6381-4b52-8055-b5ad0e7fe943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:04.799207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120af6d-6381-4b52-8055-b5ad0e7fe943 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:04.906138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 831/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:05.185896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1daa33-5710-44b4-b685-eb063d27331f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:05.190596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f1daa33-5710-44b4-b685-eb063d27331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:05.221017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1daa33-5710-44b4-b685-eb063d27331f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:05.238685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:05.240414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:05.241282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:05.242243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] PATH_INFO: `/v3/projects/94b4fb57e3ef49cd932f7909217789cb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:05.245072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b4fb57e3ef49cd932f7909217789cb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:05.262068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:05.397754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:05.405083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b4fb57e3ef49cd932f7909217789cb', 'request_id': 'req-7f5bbb59-a674-496d-a0cf-181618888e29'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:05.426949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b4fb57e3ef49cd932f7909217789cb', 'request_id': 'req-7f5bbb59-a674-496d-a0cf-181618888e29'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:05.435532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b4fb57e3ef49cd932f7909217789cb', 'request_id': 'req-7f5bbb59-a674-496d-a0cf-181618888e29'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:05.459110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] The token cache is being invalidate because project 94b4fb57e3ef49cd932f7909217789cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:05.459634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:05.460475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f5bbb59-a674-496d-a0cf-181618888e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:05.465719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 836/1667] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:05 2022] DELETE /identity/v3/projects/94b4fb57e3ef49cd932f7909217789cb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:05.467390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db8eb-2c52-4310-b463-2a52c6f7928d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:05.467837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db8eb-2c52-4310-b463-2a52c6f7928d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:05.468326 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db8eb-2c52-4310-b463-2a52c6f7928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:05.545756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-478db8eb-2c52-4310-b463-2a52c6f7928d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:05.549305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-478db8eb-2c52-4310-b463-2a52c6f7928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:05.751864 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 832/1668] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:05.759522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ef600-e593-4b97-975b-631352ccfe06 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:05.760049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ef600-e593-4b97-975b-631352ccfe06 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:05.760488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ef600-e593-4b97-975b-631352ccfe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:05.799182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3d3ef600-e593-4b97-975b-631352ccfe06 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:05.800710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3d3ef600-e593-4b97-975b-631352ccfe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:05.841277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 837/1669] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:05.845764 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db8eb-2c52-4310-b463-2a52c6f7928d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:05.867931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db8eb-2c52-4310-b463-2a52c6f7928d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:05.881885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:05.882579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:05.883014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:05.883455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:05.884087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:05.884533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:05.896904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:05.925557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 833/1670] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:05.930826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ef600-e593-4b97-975b-631352ccfe06 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:05.952638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ef600-e593-4b97-975b-631352ccfe06 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:05.970294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58207de-0170-4212-b69e-1c8462254264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:05.971256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58207de-0170-4212-b69e-1c8462254264 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:05.971464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58207de-0170-4212-b69e-1c8462254264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:05.973377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58207de-0170-4212-b69e-1c8462254264 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:05.976226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58207de-0170-4212-b69e-1c8462254264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:05.980337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58207de-0170-4212-b69e-1c8462254264 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:06.060502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 838/1671] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:05 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:06.064537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:06.078593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b521-4087-4006-acd8-a0a86cfee838 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:06.243516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7fe0d-1c6e-4479-b149-45dce19a25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:06.244169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fe0d-1c6e-4479-b149-45dce19a25a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:06.244523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fe0d-1c6e-4479-b149-45dce19a25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:06.244896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fe0d-1c6e-4479-b149-45dce19a25a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:06.245573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7fe0d-1c6e-4479-b149-45dce19a25a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:06.247640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7fe0d-1c6e-4479-b149-45dce19a25a1 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:06.308898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 834/1672] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:06 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:06.314162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58207de-0170-4212-b69e-1c8462254264 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:06.331487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58207de-0170-4212-b69e-1c8462254264 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:06.342592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763dde-9303-40e4-abf3-9c04893079bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:06.343922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763dde-9303-40e4-abf3-9c04893079bf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:06.345228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763dde-9303-40e4-abf3-9c04893079bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:06.346761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f763dde-9303-40e4-abf3-9c04893079bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:06.347728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763dde-9303-40e4-abf3-9c04893079bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:06.353670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f763dde-9303-40e4-abf3-9c04893079bf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:06.378184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 839/1673] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:06.381566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7fe0d-1c6e-4479-b149-45dce19a25a1 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:06.392918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7fe0d-1c6e-4479-b149-45dce19a25a1 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:06.408737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf54b-8be5-4a36-b72f-f6e34ea96aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:06.409427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf54b-8be5-4a36-b72f-f6e34ea96aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:06.409664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf54b-8be5-4a36-b72f-f6e34ea96aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:06.409988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf54b-8be5-4a36-b72f-f6e34ea96aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:06.410845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cf54b-8be5-4a36-b72f-f6e34ea96aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:06.412287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cf54b-8be5-4a36-b72f-f6e34ea96aaf admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:06.456935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 835/1674] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:06.458590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763dde-9303-40e4-abf3-9c04893079bf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:06.472891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f763dde-9303-40e4-abf3-9c04893079bf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:06.482602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:06.483411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:06.484274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:06.484610 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] PATH_INFO: `/v3/projects/42c6d8935aab4c1f990cb648eb1f30d2/users/ac46f25152cc45d89662ab08daf9330f/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:06.523447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c6d8935aab4c1f990cb648eb1f30d2, user_id=ac46f25152cc45d89662ab08daf9330f, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:06.543308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:06.621427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 840/1675] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:06 2022] PUT /identity/v3/projects/42c6d8935aab4c1f990cb648eb1f30d2/users/ac46f25152cc45d89662ab08daf9330f/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:06.624940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a41c-5efe-491f-8dee-86c1cf678fdf None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:06.626062 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a41c-5efe-491f-8dee-86c1cf678fdf None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:06.626815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a41c-5efe-491f-8dee-86c1cf678fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:06.701095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-26f1a41c-5efe-491f-8dee-86c1cf678fdf None None] MFA Rules not processed for user `ac46f25152cc45d89662ab08daf9330f`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:06.703476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-26f1a41c-5efe-491f-8dee-86c1cf678fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:06.749664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:06.754708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:06.791058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:06.839857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 836/1676] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:06.841047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1a41c-5efe-491f-8dee-86c1cf678fdf None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:06.925574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47dbce-cb2f-4e06-aece-120e409071db admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:06.940353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:06.941156 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:06.941566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:06.941959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] PATH_INFO: `/v3/projects/6adb2c2b14bf44a2bc20b453a2376b76` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:06.943595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6adb2c2b14bf44a2bc20b453a2376b76)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:06.958052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:07.002953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1a41c-5efe-491f-8dee-86c1cf678fdf None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:07.009767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056409d-5232-4428-9719-2283a0d09090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:07.010597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056409d-5232-4428-9719-2283a0d09090 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.010887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056409d-5232-4428-9719-2283a0d09090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.011167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056409d-5232-4428-9719-2283a0d09090 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.011865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056409d-5232-4428-9719-2283a0d09090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:07.017101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056409d-5232-4428-9719-2283a0d09090 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:07.060538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 837/1677] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:06 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:07.065861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056409d-5232-4428-9719-2283a0d09090 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:07.219205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056409d-5232-4428-9719-2283a0d09090 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:07.223569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6adb2c2b14bf44a2bc20b453a2376b76', 'request_id': 'req-450dfdbb-49e1-4aca-b349-b84e8545afd7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:07.252524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6adb2c2b14bf44a2bc20b453a2376b76', 'request_id': 'req-450dfdbb-49e1-4aca-b349-b84e8545afd7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:07.273407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6adb2c2b14bf44a2bc20b453a2376b76', 'request_id': 'req-450dfdbb-49e1-4aca-b349-b84e8545afd7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:07.297443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:07.323054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] The token cache is being invalidate because project 6adb2c2b14bf44a2bc20b453a2376b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:07.324662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:07.324992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:07.326200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.326569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.327034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.327792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:07.329525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-450dfdbb-49e1-4aca-b349-b84e8545afd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:07.331281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:07.333342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 841/1678] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:06 2022] DELETE /identity/v3/projects/6adb2c2b14bf44a2bc20b453a2376b76 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:07.338325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32045946-552d-4f28-84be-af673471734d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.338644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32045946-552d-4f28-84be-af673471734d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.339761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32045946-552d-4f28-84be-af673471734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.380718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 838/1679] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:07 2022] POST /identity/v3/users => generated 300 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:07.380718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:07.380718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:07.418979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-32045946-552d-4f28-84be-af673471734d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:07.420617 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-32045946-552d-4f28-84be-af673471734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:07.435849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:07.442240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 842/1680] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:07.450133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f999b9b-9486-49e7-bd5b-8d330f8902ac None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.450417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f999b9b-9486-49e7-bd5b-8d330f8902ac None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.450682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f999b9b-9486-49e7-bd5b-8d330f8902ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.458852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356f7c4-d12a-4c0e-b2ba-ef1c12aa2499 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:07.472256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9ce6-66f8-45e9-8d9c-9e46f0d57b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:07.473866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9ce6-66f8-45e9-8d9c-9e46f0d57b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.474169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9ce6-66f8-45e9-8d9c-9e46f0d57b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.474690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9ce6-66f8-45e9-8d9c-9e46f0d57b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.477254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b9ce6-66f8-45e9-8d9c-9e46f0d57b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:07.485830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b9ce6-66f8-45e9-8d9c-9e46f0d57b70 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:07.501406 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3f999b9b-9486-49e7-bd5b-8d330f8902ac None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:07.502956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3f999b9b-9486-49e7-bd5b-8d330f8902ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:07.532003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 843/1681] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:07.533550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150df19-d7d8-4576-ae11-649592d95b92 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.533974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150df19-d7d8-4576-ae11-649592d95b92 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.534339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150df19-d7d8-4576-ae11-649592d95b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.534784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 839/1682] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:07.535735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9ce6-66f8-45e9-8d9c-9e46f0d57b70 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:07.556046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9ce6-66f8-45e9-8d9c-9e46f0d57b70 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:07.584060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7150df19-d7d8-4576-ae11-649592d95b92 None None] MFA Rules not processed for user `ff4c71e4dd264c78840f600673d63d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:07.584927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:07.585793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7150df19-d7d8-4576-ae11-649592d95b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:07.586030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.586456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.586875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.587674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:07.588141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:07.589932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:07.618076 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 840/1683] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:07.619115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:07.637694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c241f6-ddc6-445b-bbc9-bd1d751213a5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:07.650557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec340cd0-4c1c-4234-a11f-5cb0117c2b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:07.651480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec340cd0-4c1c-4234-a11f-5cb0117c2b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.651913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec340cd0-4c1c-4234-a11f-5cb0117c2b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.652340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec340cd0-4c1c-4234-a11f-5cb0117c2b8a admin admin] PATH_INFO: `/v3/projects/5599233aa3f6455cb0d1845d8fe8aaa1/users/f1da3580ec804846bd31e635c94246c8/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.697592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec340cd0-4c1c-4234-a11f-5cb0117c2b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5599233aa3f6455cb0d1845d8fe8aaa1, user_id=f1da3580ec804846bd31e635c94246c8, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:07.700369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec340cd0-4c1c-4234-a11f-5cb0117c2b8a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:07.730898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 841/1684] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:07 2022] PUT /identity/v3/projects/5599233aa3f6455cb0d1845d8fe8aaa1/users/f1da3580ec804846bd31e635c94246c8/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:07.730898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec340cd0-4c1c-4234-a11f-5cb0117c2b8a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:07.782807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 844/1685] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:07.786384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150df19-d7d8-4576-ae11-649592d95b92 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:07.807682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150df19-d7d8-4576-ae11-649592d95b92 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:07.884656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec340cd0-4c1c-4234-a11f-5cb0117c2b8a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:07.902853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:07.903883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:07.904278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:07.904724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:07.907228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:07.909328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:07.989963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 842/1686] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:07 2022] POST /identity/v3/projects => generated 369 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:07.990843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:07.995424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:08.037637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c31b2-b559-493e-9d2c-93e617556279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.040132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c31b2-b559-493e-9d2c-93e617556279 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.040664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c31b2-b559-493e-9d2c-93e617556279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.042270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c31b2-b559-493e-9d2c-93e617556279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.046899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c31b2-b559-493e-9d2c-93e617556279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.052179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c31b2-b559-493e-9d2c-93e617556279 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.102237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 845/1687] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:08.104130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c31b2-b559-493e-9d2c-93e617556279 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:08.143069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c31b2-b559-493e-9d2c-93e617556279 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:08.201815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb465-eddc-4ea9-a5b6-385a0b07ae3a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:08.223604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba586a8-bea7-436c-b6a1-d2646281e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.224319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba586a8-bea7-436c-b6a1-d2646281e0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.224609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba586a8-bea7-436c-b6a1-d2646281e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.224894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba586a8-bea7-436c-b6a1-d2646281e0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.229434 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba586a8-bea7-436c-b6a1-d2646281e0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.231462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba586a8-bea7-436c-b6a1-d2646281e0d5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.310359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 843/1688] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:07 2022] POST /identity/v3/projects => generated 405 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:08.311368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba586a8-bea7-436c-b6a1-d2646281e0d5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:08.369550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b724bd-d8bc-404d-ae81-1d5729eb2680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.370239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b724bd-d8bc-404d-ae81-1d5729eb2680 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.370473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b724bd-d8bc-404d-ae81-1d5729eb2680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.371152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b724bd-d8bc-404d-ae81-1d5729eb2680 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.371798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b724bd-d8bc-404d-ae81-1d5729eb2680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.380957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b724bd-d8bc-404d-ae81-1d5729eb2680 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.398266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:08.433456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:08.460555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 846/1689] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:08 2022] POST /identity/v3/users => generated 285 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:08.461828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b724bd-d8bc-404d-ae81-1d5729eb2680 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:08.497678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b724bd-d8bc-404d-ae81-1d5729eb2680 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:08.512036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba586a8-bea7-436c-b6a1-d2646281e0d5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:08.513267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3eacc9-934f-4b94-a795-60bb708000bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.514256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eacc9-934f-4b94-a795-60bb708000bf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.514485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eacc9-934f-4b94-a795-60bb708000bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.515489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eacc9-934f-4b94-a795-60bb708000bf admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.517345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3eacc9-934f-4b94-a795-60bb708000bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.520201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3eacc9-934f-4b94-a795-60bb708000bf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.526917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0a45-60ea-40ee-bd84-cd80a7a56260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.528742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0a45-60ea-40ee-bd84-cd80a7a56260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.528742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0a45-60ea-40ee-bd84-cd80a7a56260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.530016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0a45-60ea-40ee-bd84-cd80a7a56260 admin admin] PATH_INFO: `/v3/projects/5599233aa3f6455cb0d1845d8fe8aaa1/users/f1da3580ec804846bd31e635c94246c8/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.535501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0a45-60ea-40ee-bd84-cd80a7a56260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5599233aa3f6455cb0d1845d8fe8aaa1, user_id=f1da3580ec804846bd31e635c94246c8, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.539476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0a45-60ea-40ee-bd84-cd80a7a56260 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.567131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 844/1690] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:08 2022] PUT /identity/v3/projects/5599233aa3f6455cb0d1845d8fe8aaa1/users/f1da3580ec804846bd31e635c94246c8/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:08.574301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 847/1691] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:08 2022] POST /identity/v3/users => generated 309 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:08.574301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3eacc9-934f-4b94-a795-60bb708000bf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:08.578464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b233f3a-df4d-4962-9370-51bd511067dc None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.578645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b233f3a-df4d-4962-9370-51bd511067dc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.578894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b233f3a-df4d-4962-9370-51bd511067dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.602436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3eacc9-934f-4b94-a795-60bb708000bf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:08.634036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-0b233f3a-df4d-4962-9370-51bd511067dc None None] MFA Rules not processed for user `f6e294533c4d431f9cec66dddec33299`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:08.636943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0b233f3a-df4d-4962-9370-51bd511067dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:08.695404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7ca48-e343-4852-8774-e0989aced8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.704141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ca48-e343-4852-8774-e0989aced8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.704713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ca48-e343-4852-8774-e0989aced8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.705162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ca48-e343-4852-8774-e0989aced8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.706107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7ca48-e343-4852-8774-e0989aced8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.709667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7ca48-e343-4852-8774-e0989aced8f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.725116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 848/1692] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:08.726785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7ca48-e343-4852-8774-e0989aced8f7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:08.740853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7ca48-e343-4852-8774-e0989aced8f7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:08.748397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d1399-d89d-48c6-a9db-b9d23c56c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.751412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d1399-d89d-48c6-a9db-b9d23c56c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.752968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d1399-d89d-48c6-a9db-b9d23c56c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.753260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d1399-d89d-48c6-a9db-b9d23c56c1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.754864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d1399-d89d-48c6-a9db-b9d23c56c1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.758128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d1399-d89d-48c6-a9db-b9d23c56c1ec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.777665 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 849/1693] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:08.794645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeaf65-11d4-4624-804f-0918af9cdfb4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.794933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeaf65-11d4-4624-804f-0918af9cdfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.795212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeaf65-11d4-4624-804f-0918af9cdfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.811924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 845/1694] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:08.814707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b233f3a-df4d-4962-9370-51bd511067dc None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:08.840491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b233f3a-df4d-4962-9370-51bd511067dc None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:08.859558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30448b92-24d7-4b6e-86f1-d66a36443e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.859558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30448b92-24d7-4b6e-86f1-d66a36443e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.859816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30448b92-24d7-4b6e-86f1-d66a36443e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.860053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30448b92-24d7-4b6e-86f1-d66a36443e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.860693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30448b92-24d7-4b6e-86f1-d66a36443e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.863964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30448b92-24d7-4b6e-86f1-d66a36443e1e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.868651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-afaeaf65-11d4-4624-804f-0918af9cdfb4 None None] MFA Rules not processed for user `f1da3580ec804846bd31e635c94246c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:08.870123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-afaeaf65-11d4-4624-804f-0918af9cdfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:08.885855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 846/1695] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:08.888635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30448b92-24d7-4b6e-86f1-d66a36443e1e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:08.902500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30448b92-24d7-4b6e-86f1-d66a36443e1e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:08.916228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e946ace-f52a-425f-9f58-dc82e48300ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:08.916732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e946ace-f52a-425f-9f58-dc82e48300ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.917017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e946ace-f52a-425f-9f58-dc82e48300ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.917302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e946ace-f52a-425f-9f58-dc82e48300ae admin admin] PATH_INFO: `/v3/projects/bf11b46efcc04840b026b6ca891adfc7/users/d34c9a22f41344f7b66027eb5198035b/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:08.939491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e946ace-f52a-425f-9f58-dc82e48300ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf11b46efcc04840b026b6ca891adfc7, user_id=d34c9a22f41344f7b66027eb5198035b, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:08.949483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e946ace-f52a-425f-9f58-dc82e48300ae admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:08.973161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 847/1696] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:08 2022] PUT /identity/v3/projects/bf11b46efcc04840b026b6ca891adfc7/users/d34c9a22f41344f7b66027eb5198035b/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:08.977660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9461-f590-434d-83f1-fc651428ae68 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:08.978275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9461-f590-434d-83f1-fc651428ae68 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:08.978508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb9461-f590-434d-83f1-fc651428ae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:09.010420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 850/1697] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:09.010420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeaf65-11d4-4624-804f-0918af9cdfb4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:09.010652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-9bcb9461-f590-434d-83f1-fc651428ae68 None None] MFA Rules not processed for user `f6e294533c4d431f9cec66dddec33299`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:09.011388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9bcb9461-f590-434d-83f1-fc651428ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:09.036288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeaf65-11d4-4624-804f-0918af9cdfb4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:09.131860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 848/1698] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:09.136575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb9461-f590-434d-83f1-fc651428ae68 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:09.176373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:09.182971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:09.228778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:09.228778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:09.228778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:09.233404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] PATH_INFO: `/v3/projects/f7bf5193ad6a4356a211bc5655ef5d20/users/c2fd173544f84477b502aa4d2affd150/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:09.261348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7bf5193ad6a4356a211bc5655ef5d20, user_id=c2fd173544f84477b502aa4d2affd150, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:09.269480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:09.308384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb9461-f590-434d-83f1-fc651428ae68 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:09.321548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 851/1699] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:09 2022] PUT /identity/v3/projects/f7bf5193ad6a4356a211bc5655ef5d20/users/c2fd173544f84477b502aa4d2affd150/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:09.330118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:09.332082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:09.339330 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:09.339630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:09.339791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:09.340319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:09.340474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:09.342175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:09.386534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 849/1700] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:09.387562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:09.391738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:09.423223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4053f1-0115-4116-ba76-ed854028e4c7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:09.550797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b110f-f8ec-4cf9-bb81-4c0b756a7d6d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:09.557462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:09.558621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:09.559928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:09.560213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:09.586551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:09.587279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:09.587601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:09.587958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] PATH_INFO: `/v3/users/2ab0d858a11e49cb877afebaf0971411` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:09.589536 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab0d858a11e49cb877afebaf0971411)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:09.605134 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:09.751500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:09.752761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab0d858a11e49cb877afebaf0971411'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:09.754951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:09.755211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab0d858a11e49cb877afebaf0971411'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:09.789142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 852/1701] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:09.794858 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab0d858a11e49cb877afebaf0971411'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:09.801386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:09.824141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:09.835661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab0d858a11e49cb877afebaf0971411'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:09.838326 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e172b81f-c11c-4ee4-89c3-981e1c0f8840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab0d858a11e49cb877afebaf0971411'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:09.887133 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 850/1702] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:09 2022] DELETE /identity/v3/users/2ab0d858a11e49cb877afebaf0971411 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:09.897829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449d08-f539-4557-a710-2c1ca383de09 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:09.898137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449d08-f539-4557-a710-2c1ca383de09 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:09.898418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449d08-f539-4557-a710-2c1ca383de09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:09.997205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-82449d08-f539-4557-a710-2c1ca383de09 None None] MFA Rules not processed for user `c2fd173544f84477b502aa4d2affd150`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:09.998491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-82449d08-f539-4557-a710-2c1ca383de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:10.080733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:10.096142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da52353-d461-46c0-ac16-116f09f7a3de service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:10.179516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:10.228819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 851/1703] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:10.229497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449d08-f539-4557-a710-2c1ca383de09 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:10.235950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-82449d08-f539-4557-a710-2c1ca383de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:10.312844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:10.313697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:10.314029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:10.314429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:10.317588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:10.415784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449d08-f539-4557-a710-2c1ca383de09 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:10.435163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764f09d-ce42-4c6d-86cb-5ef631c5b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:10.436195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764f09d-ce42-4c6d-86cb-5ef631c5b745 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:10.436823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764f09d-ce42-4c6d-86cb-5ef631c5b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:10.438232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764f09d-ce42-4c6d-86cb-5ef631c5b745 admin admin] PATH_INFO: `/v3/projects/bf11b46efcc04840b026b6ca891adfc7/users/d34c9a22f41344f7b66027eb5198035b/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:10.442524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764f09d-ce42-4c6d-86cb-5ef631c5b745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf11b46efcc04840b026b6ca891adfc7, user_id=d34c9a22f41344f7b66027eb5198035b, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:10.446293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764f09d-ce42-4c6d-86cb-5ef631c5b745 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:10.486293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:10.487945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:10.490660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 852/1704] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:10 2022] PUT /identity/v3/projects/bf11b46efcc04840b026b6ca891adfc7/users/d34c9a22f41344f7b66027eb5198035b/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:10.491938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a818318-03fe-48cc-89aa-5c87348a898b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:10.494837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a818318-03fe-48cc-89aa-5c87348a898b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:10.495131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a818318-03fe-48cc-89aa-5c87348a898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:10.499660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 853/1705] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:10.501078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:10.507108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:10.539589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c8615-0936-4d53-8718-fe400f06a9da service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:10.551247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3a818318-03fe-48cc-89aa-5c87348a898b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:10.560549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3a818318-03fe-48cc-89aa-5c87348a898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:10.665342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:10.668963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:10.681605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:10.682077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] PATH_INFO: `/v3/users/ac46f25152cc45d89662ab08daf9330f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:10.684147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac46f25152cc45d89662ab08daf9330f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:10.687501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:10.764556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 853/1706] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:10.767095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9247-de43-4ebf-a970-a08a108f1190 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:10.769056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9247-de43-4ebf-a970-a08a108f1190 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:10.770210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d9247-de43-4ebf-a970-a08a108f1190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:10.789298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac46f25152cc45d89662ab08daf9330f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:10.790232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac46f25152cc45d89662ab08daf9330f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:10.805786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:10.808136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac46f25152cc45d89662ab08daf9330f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:10.820210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac46f25152cc45d89662ab08daf9330f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:10.821223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac46f25152cc45d89662ab08daf9330f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:10.840194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 854/1707] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:10 2022] DELETE /identity/v3/users/ac46f25152cc45d89662ab08daf9330f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:10.841145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:10.842600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:10.843477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e40d9247-de43-4ebf-a970-a08a108f1190 None None] MFA Rules not processed for user `59499f8f98f9474c8eda196a712d752e`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:10.846850 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e40d9247-de43-4ebf-a970-a08a108f1190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:10.947116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb307a98-5e2e-4527-938d-f3a0853f27ce admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:10.951763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:10.960323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16147d8d-a91d-4295-9bea-0e0d06a66b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:10.961159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16147d8d-a91d-4295-9bea-0e0d06a66b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:10.961344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16147d8d-a91d-4295-9bea-0e0d06a66b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:10.962127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16147d8d-a91d-4295-9bea-0e0d06a66b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:10.969201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16147d8d-a91d-4295-9bea-0e0d06a66b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:10.978126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16147d8d-a91d-4295-9bea-0e0d06a66b2d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:10.986810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 854/1708] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:10.988444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d9247-de43-4ebf-a970-a08a108f1190 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:10.991935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e40d9247-de43-4ebf-a970-a08a108f1190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:11.048606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 855/1709] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:10 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:11.050185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a874fb-e38f-4caa-af96-04608084a3cc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.050478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a874fb-e38f-4caa-af96-04608084a3cc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.050759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a874fb-e38f-4caa-af96-04608084a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.098752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-54a874fb-e38f-4caa-af96-04608084a3cc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:11.104244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54a874fb-e38f-4caa-af96-04608084a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:11.110084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d9247-de43-4ebf-a970-a08a108f1190 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:11.254867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 856/1710] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:11.260371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a874fb-e38f-4caa-af96-04608084a3cc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:11.264242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54a874fb-e38f-4caa-af96-04608084a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:11.266082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:11.268310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.269576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.269987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.275011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:11.303506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:11.309706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:11.335744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 855/1711] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:11.340198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:11.364393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9277f14-ec9e-4c97-8e05-398d2db0a3ca service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:11.379460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac05196-a663-4207-9527-cf7058d5da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:11.380195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac05196-a663-4207-9527-cf7058d5da20 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.380963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac05196-a663-4207-9527-cf7058d5da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.381194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac05196-a663-4207-9527-cf7058d5da20 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.381881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac05196-a663-4207-9527-cf7058d5da20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:11.383853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac05196-a663-4207-9527-cf7058d5da20 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:11.439033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 856/1712] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:11 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:11.440391 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac05196-a663-4207-9527-cf7058d5da20 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:11.453887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:11.468510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a874fb-e38f-4caa-af96-04608084a3cc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:11.470913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac05196-a663-4207-9527-cf7058d5da20 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:11.481734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dad7e-6f1c-413b-91bd-4afa3104c420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:11.482445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dad7e-6f1c-413b-91bd-4afa3104c420 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.482716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dad7e-6f1c-413b-91bd-4afa3104c420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.482996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dad7e-6f1c-413b-91bd-4afa3104c420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.484999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d3c4b-b340-478a-b4fd-4e3a10bb5e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:11.485676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d3c4b-b340-478a-b4fd-4e3a10bb5e4d service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.485986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d3c4b-b340-478a-b4fd-4e3a10bb5e4d service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.486313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d3c4b-b340-478a-b4fd-4e3a10bb5e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.512121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dad7e-6f1c-413b-91bd-4afa3104c420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:11.517243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dad7e-6f1c-413b-91bd-4afa3104c420 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:11.533778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 857/1713] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:11.535768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dad7e-6f1c-413b-91bd-4afa3104c420 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:11.551088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dad7e-6f1c-413b-91bd-4afa3104c420 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:11.558222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250693dc-bcff-40af-bac3-b9ebc8a94cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:11.558851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250693dc-bcff-40af-bac3-b9ebc8a94cda admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.559136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250693dc-bcff-40af-bac3-b9ebc8a94cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.559569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250693dc-bcff-40af-bac3-b9ebc8a94cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.560666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250693dc-bcff-40af-bac3-b9ebc8a94cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:11.563119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250693dc-bcff-40af-bac3-b9ebc8a94cda admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:11.578201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 858/1714] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:11.579667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf532-488b-4dd7-bc16-4faa6ac43c0e None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.580102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf532-488b-4dd7-bc16-4faa6ac43c0e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.580459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf532-488b-4dd7-bc16-4faa6ac43c0e None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.582557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 859/1715] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 26 15:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:11.583333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bf532-488b-4dd7-bc16-4faa6ac43c0e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:11.604391 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bf532-488b-4dd7-bc16-4faa6ac43c0e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:11.627084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6eb02-f54c-4e50-aecc-69f0b672002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:11.629160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6eb02-f54c-4e50-aecc-69f0b672002c admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.629445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6eb02-f54c-4e50-aecc-69f0b672002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.629717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6eb02-f54c-4e50-aecc-69f0b672002c admin admin] PATH_INFO: `/v3/projects/c0bcbeb398a84a1d9b0e3ffa548cfe05/users/1f19f53fdb754809b28fe841bb68411a/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.642762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d3c4b-b340-478a-b4fd-4e3a10bb5e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:11.644621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d3c4b-b340-478a-b4fd-4e3a10bb5e4d service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:11.665867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6eb02-f54c-4e50-aecc-69f0b672002c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bcbeb398a84a1d9b0e3ffa548cfe05, user_id=1f19f53fdb754809b28fe841bb68411a, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:11.669121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 857/1716] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:11.671922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c95e0-7e0c-45e4-bbe3-a1e256934f7d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.673658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c95e0-7e0c-45e4-bbe3-a1e256934f7d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.673658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c95e0-7e0c-45e4-bbe3-a1e256934f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.686222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6eb02-f54c-4e50-aecc-69f0b672002c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:11.726201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 860/1717] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:11 2022] PUT /identity/v3/projects/c0bcbeb398a84a1d9b0e3ffa548cfe05/users/1f19f53fdb754809b28fe841bb68411a/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:11.730673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6eb02-f54c-4e50-aecc-69f0b672002c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:11.774736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ea0c95e0-7e0c-45e4-bbe3-a1e256934f7d None None] MFA Rules not processed for user `9962d812513a428b99ada1f79a5b88d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:11.776112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ea0c95e0-7e0c-45e4-bbe3-a1e256934f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:11.885634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:11.941146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6eb02-f54c-4e50-aecc-69f0b672002c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:11.956333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cfdcf-e2ba-4976-a0d7-ac337770381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:11.958225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cfdcf-e2ba-4976-a0d7-ac337770381f admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:11.958225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cfdcf-e2ba-4976-a0d7-ac337770381f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:11.958225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cfdcf-e2ba-4976-a0d7-ac337770381f admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:11.961865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cfdcf-e2ba-4976-a0d7-ac337770381f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:11.964342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cfdcf-e2ba-4976-a0d7-ac337770381f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:11.978104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 861/1718] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:40:11.982572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cfdcf-e2ba-4976-a0d7-ac337770381f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:12.020090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cfdcf-e2ba-4976-a0d7-ac337770381f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:12.022922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 858/1719] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:40:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:12.033817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9395d02-c64e-4cfa-a2ec-638074483c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:12.034765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9395d02-c64e-4cfa-a2ec-638074483c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:12.036030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9395d02-c64e-4cfa-a2ec-638074483c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:12.037213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9395d02-c64e-4cfa-a2ec-638074483c11 admin admin] PATH_INFO: `/v3/projects/c0bcbeb398a84a1d9b0e3ffa548cfe05/users/1f19f53fdb754809b28fe841bb68411a/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:12.047591 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9395d02-c64e-4cfa-a2ec-638074483c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bcbeb398a84a1d9b0e3ffa548cfe05, user_id=1f19f53fdb754809b28fe841bb68411a, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:12.052529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9395d02-c64e-4cfa-a2ec-638074483c11 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:12.089759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 862/1720] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:11 2022] PUT /identity/v3/projects/c0bcbeb398a84a1d9b0e3ffa548cfe05/users/1f19f53fdb754809b28fe841bb68411a/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:12.091760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c95e0-7e0c-45e4-bbe3-a1e256934f7d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:12.093815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ea0c95e0-7e0c-45e4-bbe3-a1e256934f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:12.110952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4b511-c1b5-4008-ae00-b7bebb7720ef None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:12.111394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4b511-c1b5-4008-ae00-b7bebb7720ef None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:12.111782 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4b511-c1b5-4008-ae00-b7bebb7720ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:12.117443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c95e0-7e0c-45e4-bbe3-a1e256934f7d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:12.199889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-43e4b511-c1b5-4008-ae00-b7bebb7720ef None None] MFA Rules not processed for user `1f19f53fdb754809b28fe841bb68411a`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:12.205496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-43e4b511-c1b5-4008-ae00-b7bebb7720ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:12.250984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:12.253758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:12.254278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:12.254998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:12.276813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:12.278534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:12.304346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 859/1721] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:12.390698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 863/1722] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:12.404539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:12.410445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:12.435358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4b511-c1b5-4008-ae00-b7bebb7720ef None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:12.437503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-43e4b511-c1b5-4008-ae00-b7bebb7720ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:12.562515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:12.583587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c734c-e27a-4fad-b0f3-1e2bc9698b7f service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:12.609236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b13f3-389a-4144-85f5-bfc8189ff726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:12.610337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b13f3-389a-4144-85f5-bfc8189ff726 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:12.612461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b13f3-389a-4144-85f5-bfc8189ff726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:12.612947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b13f3-389a-4144-85f5-bfc8189ff726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:12.616290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4b511-c1b5-4008-ae00-b7bebb7720ef None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:12.623222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:12.623961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:12.624252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:12.624531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] PATH_INFO: `/v3/projects/42c6d8935aab4c1f990cb648eb1f30d2` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:12.627317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c6d8935aab4c1f990cb648eb1f30d2)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:12.631127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:12.643643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b13f3-389a-4144-85f5-bfc8189ff726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:12.645435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b13f3-389a-4144-85f5-bfc8189ff726 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:12.686105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 860/1723] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:12.688373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d42a88-1025-4c02-beb6-5a9fb17bc3e8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:12.690412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d42a88-1025-4c02-beb6-5a9fb17bc3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:12.691464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d42a88-1025-4c02-beb6-5a9fb17bc3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:12.724760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c6d8935aab4c1f990cb648eb1f30d2', 'request_id': 'req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:12.727480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:12.737529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c6d8935aab4c1f990cb648eb1f30d2', 'request_id': 'req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:12.754580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c6d8935aab4c1f990cb648eb1f30d2', 'request_id': 'req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:12.781996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-62d42a88-1025-4c02-beb6-5a9fb17bc3e8 None None] MFA Rules not processed for user `725058b77fb64ed2a8a31869df3d2a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:12.783062 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] The token cache is being invalidate because project 42c6d8935aab4c1f990cb648eb1f30d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:12.783727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-62d42a88-1025-4c02-beb6-5a9fb17bc3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:12.783865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:12.784481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:12.790928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 864/1724] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:12 2022] DELETE /identity/v3/projects/42c6d8935aab4c1f990cb648eb1f30d2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:12.790928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:12.791151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:12.943418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0834f93-d1f4-4df1-b6de-2c8c080e19d7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:12.944830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 861/1725] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:12.947528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d42a88-1025-4c02-beb6-5a9fb17bc3e8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:12.949702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-62d42a88-1025-4c02-beb6-5a9fb17bc3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:12.956917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:12.957600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:12.958006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:12.958232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] PATH_INFO: `/v3/projects/70868d9dd4584128b01e0c2213d2f885` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:12.960153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70868d9dd4584128b01e0c2213d2f885)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:12.966740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:12.992172 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d42a88-1025-4c02-beb6-5a9fb17bc3e8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:13.005659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:13.008006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.008548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.009901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] PATH_INFO: `/v3/users/f1da3580ec804846bd31e635c94246c8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.031313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1da3580ec804846bd31e635c94246c8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:13.045261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:13.150401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70868d9dd4584128b01e0c2213d2f885', 'request_id': 'req-fe9b17c3-f23f-4c89-a5a6-700da2359229'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.168353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70868d9dd4584128b01e0c2213d2f885', 'request_id': 'req-fe9b17c3-f23f-4c89-a5a6-700da2359229'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.173973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1da3580ec804846bd31e635c94246c8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.175221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1da3580ec804846bd31e635c94246c8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.184968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70868d9dd4584128b01e0c2213d2f885', 'request_id': 'req-fe9b17c3-f23f-4c89-a5a6-700da2359229'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.204305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] The token cache is being invalidate because project 70868d9dd4584128b01e0c2213d2f885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:13.204602 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.205228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1da3580ec804846bd31e635c94246c8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.206612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.210985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 865/1726] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:12 2022] DELETE /identity/v3/projects/70868d9dd4584128b01e0c2213d2f885 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:13.214410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:13.215405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.219605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1da3580ec804846bd31e635c94246c8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.220728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dfa8626e-668f-49e0-9026-a7fb7a489cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1da3580ec804846bd31e635c94246c8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:13.239322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 862/1727] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:12 2022] DELETE /identity/v3/users/f1da3580ec804846bd31e635c94246c8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:13.241125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438485f-00a8-4ea5-9a6c-0d2aaed9faea None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.241519 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438485f-00a8-4ea5-9a6c-0d2aaed9faea None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.242024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438485f-00a8-4ea5-9a6c-0d2aaed9faea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.267435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7438485f-00a8-4ea5-9a6c-0d2aaed9faea None None] MFA Rules not processed for user `725058b77fb64ed2a8a31869df3d2a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:13.268874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7438485f-00a8-4ea5-9a6c-0d2aaed9faea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.354722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:13.389883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b17c3-f23f-4c89-a5a6-700da2359229 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:13.397454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 863/1728] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:13.400129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a439a-04e6-45ef-a8b8-60101e9635d6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.402135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a439a-04e6-45ef-a8b8-60101e9635d6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.402135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a439a-04e6-45ef-a8b8-60101e9635d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.479936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-901a439a-04e6-45ef-a8b8-60101e9635d6 None None] MFA Rules not processed for user `d34c9a22f41344f7b66027eb5198035b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:13.486549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-901a439a-04e6-45ef-a8b8-60101e9635d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.531916 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:13.622699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:13.623552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.624093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.624609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.632892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.727071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 864/1729] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:13.728972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2af1-fa00-4fd2-ba66-9c9c468344fa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.729265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2af1-fa00-4fd2-ba66-9c9c468344fa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.731585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f2af1-fa00-4fd2-ba66-9c9c468344fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.781310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9a3f2af1-fa00-4fd2-ba66-9c9c468344fa None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:13.782916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a3f2af1-fa00-4fd2-ba66-9c9c468344fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.826057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:13.828339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:13.850907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 866/1730] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:13.851251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:13.854635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.966262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 865/1731] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:13.967248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f2af1-fa00-4fd2-ba66-9c9c468344fa None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:13.973874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a3f2af1-fa00-4fd2-ba66-9c9c468344fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.115841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a6e5b-fbee-4a27-a813-7c786b0d25e2 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.138370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40d3eb-40e0-4a59-b2e9-d03afa408d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.139024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d3eb-40e0-4a59-b2e9-d03afa408d6c service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.139312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d3eb-40e0-4a59-b2e9-d03afa408d6c service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.140492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40d3eb-40e0-4a59-b2e9-d03afa408d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.142675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ed40d3eb-40e0-4a59-b2e9-d03afa408d6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.162922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d3eb-40e0-4a59-b2e9-d03afa408d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.165574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40d3eb-40e0-4a59-b2e9-d03afa408d6c service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.191848 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 867/1732] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:14.193239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f67802-8075-465f-8341-0487fd564fcf None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.193529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f67802-8075-465f-8341-0487fd564fcf None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.193808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f67802-8075-465f-8341-0487fd564fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.254537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-18f67802-8075-465f-8341-0487fd564fcf None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.256953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-18f67802-8075-465f-8341-0487fd564fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.261278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f2af1-fa00-4fd2-ba66-9c9c468344fa None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.273000 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.278157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.279694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.280024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.289454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.291241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 868/1733] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.298953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f67802-8075-465f-8341-0487fd564fcf None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.331770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f67802-8075-465f-8341-0487fd564fcf None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.345402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.350204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.350722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.351006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.351286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.351955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:14.352265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.352830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.355251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.406088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 866/1734] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:14.406610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 869/1735] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:14.412703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.449080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77af7-64ce-472f-8379-07e4d20f33ba service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.467191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.470473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.470767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.471048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.475822 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.480088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.502066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:14.622025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 867/1736] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:14.629448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.632161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.644654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.659689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83018-b1cb-44dc-bfb7-368f9f3aabdb admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.870886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:14.897590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a41d70-9975-49d4-bd43-4dfe4095916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.898217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a41d70-9975-49d4-bd43-4dfe4095916e admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.898501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a41d70-9975-49d4-bd43-4dfe4095916e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.898930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a41d70-9975-49d4-bd43-4dfe4095916e admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.899582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a41d70-9975-49d4-bd43-4dfe4095916e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.902816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a41d70-9975-49d4-bd43-4dfe4095916e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.911525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d5b7-1eb6-4cf0-b6ae-355bcaa1efc2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.920678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.921377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.921667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.922189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] PATH_INFO: `/v3/projects/5599233aa3f6455cb0d1845d8fe8aaa1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.924375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5599233aa3f6455cb0d1845d8fe8aaa1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.930768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.952699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 870/1737] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:14.957066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a41d70-9975-49d4-bd43-4dfe4095916e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.982523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a41d70-9975-49d4-bd43-4dfe4095916e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.996194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ca1c-e252-423b-aa81-882939a304df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.996826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ca1c-e252-423b-aa81-882939a304df admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.997110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ca1c-e252-423b-aa81-882939a304df admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.997390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ca1c-e252-423b-aa81-882939a304df admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.998087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10ca1c-e252-423b-aa81-882939a304df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.001682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10ca1c-e252-423b-aa81-882939a304df admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.023591 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 871/1738] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:15.027455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ca1c-e252-423b-aa81-882939a304df admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.042878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ca1c-e252-423b-aa81-882939a304df admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.056390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5599233aa3f6455cb0d1845d8fe8aaa1', 'request_id': 'req-7ca05f3c-153b-48ec-843d-fb00d7fededa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:15.070752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5599233aa3f6455cb0d1845d8fe8aaa1', 'request_id': 'req-7ca05f3c-153b-48ec-843d-fb00d7fededa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:15.080153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5599233aa3f6455cb0d1845d8fe8aaa1', 'request_id': 'req-7ca05f3c-153b-48ec-843d-fb00d7fededa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:15.106980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] The token cache is being invalidate because project 5599233aa3f6455cb0d1845d8fe8aaa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:15.116106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:15.118293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ca05f3c-153b-48ec-843d-fb00d7fededa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:15.132555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 868/1739] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:14 2022] DELETE /identity/v3/projects/5599233aa3f6455cb0d1845d8fe8aaa1 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:15.134273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc0d5-d144-4fac-8d70-79845d0cc695 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.138464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc0d5-d144-4fac-8d70-79845d0cc695 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.140518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc0d5-d144-4fac-8d70-79845d0cc695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.208647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-34efc0d5-d144-4fac-8d70-79845d0cc695 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:15.210398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-34efc0d5-d144-4fac-8d70-79845d0cc695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:15.234191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.238623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.238924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.240128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.240813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.245412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.277881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 872/1740] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:40:15.281490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.288424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:15.335211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586365-c55a-4747-b0f9-b20382f587f2 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.348960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be0c13-8dd5-4791-9aed-e9bfffb66d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.349662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be0c13-8dd5-4791-9aed-e9bfffb66d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.349977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be0c13-8dd5-4791-9aed-e9bfffb66d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.350402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be0c13-8dd5-4791-9aed-e9bfffb66d58 admin admin] PATH_INFO: `/v3/projects/fd6571253ee742c3afd87b68ae89daf3/users/8b0679ba5ad04d4cac7d07e6171197f6/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.389042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be0c13-8dd5-4791-9aed-e9bfffb66d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6571253ee742c3afd87b68ae89daf3, user_id=8b0679ba5ad04d4cac7d07e6171197f6, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.392050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be0c13-8dd5-4791-9aed-e9bfffb66d58 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.411636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 869/1741] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:15.423948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 873/1742] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:15 2022] PUT /identity/v3/projects/fd6571253ee742c3afd87b68ae89daf3/users/8b0679ba5ad04d4cac7d07e6171197f6/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:15.425188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c07ae6-5330-4bc7-872d-b6e60df39c5c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.425887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c07ae6-5330-4bc7-872d-b6e60df39c5c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.426383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c07ae6-5330-4bc7-872d-b6e60df39c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.426812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4ebb-516e-4b3c-a3af-fd511fbb22f1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.427100 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4ebb-516e-4b3c-a3af-fd511fbb22f1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.427382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4ebb-516e-4b3c-a3af-fd511fbb22f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.471733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f6c07ae6-5330-4bc7-872d-b6e60df39c5c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:15.473189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f6c07ae6-5330-4bc7-872d-b6e60df39c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:15.499910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b31e4ebb-516e-4b3c-a3af-fd511fbb22f1 None None] MFA Rules not processed for user `8b0679ba5ad04d4cac7d07e6171197f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:15.501180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b31e4ebb-516e-4b3c-a3af-fd511fbb22f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:15.502302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:15.618209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 870/1743] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:15.619383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c07ae6-5330-4bc7-872d-b6e60df39c5c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.663259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c07ae6-5330-4bc7-872d-b6e60df39c5c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.681165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 874/1744] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 26 15:40:15.686289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4ebb-516e-4b3c-a3af-fd511fbb22f1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.688129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.689819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.691189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.694643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.695250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:15.695879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.704883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.717609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4ebb-516e-4b3c-a3af-fd511fbb22f1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.735810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cc452-8e22-4eed-b352-614bdca73ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.737952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cc452-8e22-4eed-b352-614bdca73ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.739535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cc452-8e22-4eed-b352-614bdca73ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.740380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cc452-8e22-4eed-b352-614bdca73ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.742517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cc452-8e22-4eed-b352-614bdca73ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.767104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 871/1745] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:15.767104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.769063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cc452-8e22-4eed-b352-614bdca73ed8 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.789378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525111-89c6-48b9-90d8-038cff95ea17 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.799871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e559-b0ee-414d-aade-02fc1f5ab3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.800495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e559-b0ee-414d-aade-02fc1f5ab3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.800775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e559-b0ee-414d-aade-02fc1f5ab3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.801049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e559-b0ee-414d-aade-02fc1f5ab3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.801678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6e559-b0ee-414d-aade-02fc1f5ab3fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.805042 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6e559-b0ee-414d-aade-02fc1f5ab3fb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.862646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 875/1746] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.869756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cc452-8e22-4eed-b352-614bdca73ed8 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.885725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:15.896362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 872/1747] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.899003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e559-b0ee-414d-aade-02fc1f5ab3fb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.048545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cc452-8e22-4eed-b352-614bdca73ed8 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.061926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e559-b0ee-414d-aade-02fc1f5ab3fb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.064388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ac7c-36a1-4885-befc-bda6f99662dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.065025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ac7c-36a1-4885-befc-bda6f99662dc admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.065556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ac7c-36a1-4885-befc-bda6f99662dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.065930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987ac7c-36a1-4885-befc-bda6f99662dc admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.066580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987ac7c-36a1-4885-befc-bda6f99662dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.069157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987ac7c-36a1-4885-befc-bda6f99662dc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.080159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ff8f-af73-412d-81f0-2f09f28a7f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.080862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ff8f-af73-412d-81f0-2f09f28a7f60 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.081175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ff8f-af73-412d-81f0-2f09f28a7f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.081456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ff8f-af73-412d-81f0-2f09f28a7f60 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.083102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7ff8f-af73-412d-81f0-2f09f28a7f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.084359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7ff8f-af73-412d-81f0-2f09f28a7f60 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.124259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 873/1748] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:16.132148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ff8f-af73-412d-81f0-2f09f28a7f60 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.139028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 876/1749] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:16.140356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ac7c-36a1-4885-befc-bda6f99662dc admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.157444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987ac7c-36a1-4885-befc-bda6f99662dc admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.158108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ff8f-af73-412d-81f0-2f09f28a7f60 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.170193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc52d1-2c99-40eb-a886-292499369efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.172048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc52d1-2c99-40eb-a886-292499369efd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.172745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc52d1-2c99-40eb-a886-292499369efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.172895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f09680-ad3f-4f90-9b58-674d52b92692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.173478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f09680-ad3f-4f90-9b58-674d52b92692 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.173811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f09680-ad3f-4f90-9b58-674d52b92692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.173930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc52d1-2c99-40eb-a886-292499369efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.174173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f09680-ad3f-4f90-9b58-674d52b92692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.175038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f09680-ad3f-4f90-9b58-674d52b92692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.175763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc52d1-2c99-40eb-a886-292499369efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.176948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f09680-ad3f-4f90-9b58-674d52b92692 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.180182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc52d1-2c99-40eb-a886-292499369efd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.194423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 877/1750] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.195800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f09680-ad3f-4f90-9b58-674d52b92692 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.209451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 874/1751] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.213140 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc52d1-2c99-40eb-a886-292499369efd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.216923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f09680-ad3f-4f90-9b58-674d52b92692 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.231550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8420108-1c2f-4f38-9dd2-9e3e6e3ca906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.232385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420108-1c2f-4f38-9dd2-9e3e6e3ca906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.232771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420108-1c2f-4f38-9dd2-9e3e6e3ca906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.233829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420108-1c2f-4f38-9dd2-9e3e6e3ca906 admin admin] PATH_INFO: `/v3/projects/15dee189bb5f47b3a32bb45b0c1c7b40/users/397e09da9f3444d4a033f415d3a08061/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.247561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc52d1-2c99-40eb-a886-292499369efd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.262660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8420108-1c2f-4f38-9dd2-9e3e6e3ca906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15dee189bb5f47b3a32bb45b0c1c7b40, user_id=397e09da9f3444d4a033f415d3a08061, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.264816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751adb6-e7bf-4a71-ac87-7c977126ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.265404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8420108-1c2f-4f38-9dd2-9e3e6e3ca906 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.265818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751adb6-e7bf-4a71-ac87-7c977126ad4b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.266870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751adb6-e7bf-4a71-ac87-7c977126ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.267163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751adb6-e7bf-4a71-ac87-7c977126ad4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.268258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751adb6-e7bf-4a71-ac87-7c977126ad4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.271914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751adb6-e7bf-4a71-ac87-7c977126ad4b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.286491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 878/1752] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:16 2022] PUT /identity/v3/projects/15dee189bb5f47b3a32bb45b0c1c7b40/users/397e09da9f3444d4a033f415d3a08061/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:16.287510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8420108-1c2f-4f38-9dd2-9e3e6e3ca906 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.306535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 875/1753] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.307983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751adb6-e7bf-4a71-ac87-7c977126ad4b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.324642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751adb6-e7bf-4a71-ac87-7c977126ad4b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.444417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8420108-1c2f-4f38-9dd2-9e3e6e3ca906 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.473939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d890b4d-b306-4827-ae9b-098f0e7499a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.474579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d890b4d-b306-4827-ae9b-098f0e7499a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.474862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d890b4d-b306-4827-ae9b-098f0e7499a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.475198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d890b4d-b306-4827-ae9b-098f0e7499a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.475794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d890b4d-b306-4827-ae9b-098f0e7499a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.483703 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d890b4d-b306-4827-ae9b-098f0e7499a1 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.489158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:16.513988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 879/1754] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.523242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d890b4d-b306-4827-ae9b-098f0e7499a1 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.541059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d890b4d-b306-4827-ae9b-098f0e7499a1 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.550719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aaa41-8df1-4290-a4fb-00b3898b860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.551598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aaa41-8df1-4290-a4fb-00b3898b860a admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.551676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aaa41-8df1-4290-a4fb-00b3898b860a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.552275 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aaa41-8df1-4290-a4fb-00b3898b860a admin admin] PATH_INFO: `/v3/projects/be644cdbd82345889cca136bbb15e5e5/users/96f9dd61d37a42fe8d36f723282aed6e/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.574374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0598080-02a4-4ae4-b366-5a3ba8ef9d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.575639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598080-02a4-4ae4-b366-5a3ba8ef9d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.576256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598080-02a4-4ae4-b366-5a3ba8ef9d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.576716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0598080-02a4-4ae4-b366-5a3ba8ef9d3c admin admin] PATH_INFO: `/v3/projects/15dee189bb5f47b3a32bb45b0c1c7b40/users/397e09da9f3444d4a033f415d3a08061/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.579714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aaa41-8df1-4290-a4fb-00b3898b860a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be644cdbd82345889cca136bbb15e5e5, user_id=96f9dd61d37a42fe8d36f723282aed6e, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.582428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0598080-02a4-4ae4-b366-5a3ba8ef9d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15dee189bb5f47b3a32bb45b0c1c7b40, user_id=397e09da9f3444d4a033f415d3a08061, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.582562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aaa41-8df1-4290-a4fb-00b3898b860a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.587231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0598080-02a4-4ae4-b366-5a3ba8ef9d3c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.613458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 880/1755] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:16 2022] PUT /identity/v3/projects/15dee189bb5f47b3a32bb45b0c1c7b40/users/397e09da9f3444d4a033f415d3a08061/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:16.640220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 876/1756] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:16 2022] PUT /identity/v3/projects/be644cdbd82345889cca136bbb15e5e5/users/96f9dd61d37a42fe8d36f723282aed6e/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:16.646421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff81a-5a6e-4288-bb8b-ecab2237156c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.646593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff81a-5a6e-4288-bb8b-ecab2237156c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.646849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff81a-5a6e-4288-bb8b-ecab2237156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.647554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cecda7-7dfb-418f-98f5-eb8bfdce9880 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.648030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cecda7-7dfb-418f-98f5-eb8bfdce9880 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.648153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cecda7-7dfb-418f-98f5-eb8bfdce9880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.745219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-7b3ff81a-5a6e-4288-bb8b-ecab2237156c None None] MFA Rules not processed for user `397e09da9f3444d4a033f415d3a08061`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:16.747416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7b3ff81a-5a6e-4288-bb8b-ecab2237156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:16.754065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-35cecda7-7dfb-418f-98f5-eb8bfdce9880 None None] MFA Rules not processed for user `96f9dd61d37a42fe8d36f723282aed6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:16.758331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-35cecda7-7dfb-418f-98f5-eb8bfdce9880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:16.903774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:17.047312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 877/1757] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:17.048717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344c685-963b-47f8-903a-5c6a59e033a8 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.049012 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344c685-963b-47f8-903a-5c6a59e033a8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.049294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344c685-963b-47f8-903a-5c6a59e033a8 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.060363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 878/1758] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 26 15:40:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:17.061348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344c685-963b-47f8-903a-5c6a59e033a8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.062619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 881/1759] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:17.064039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e3183-2128-44f6-a4c6-5ec06df4d82a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.064327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e3183-2128-44f6-a4c6-5ec06df4d82a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.064605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e3183-2128-44f6-a4c6-5ec06df4d82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.123781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-be2e3183-2128-44f6-a4c6-5ec06df4d82a None None] MFA Rules not processed for user `9962d812513a428b99ada1f79a5b88d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:17.125752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-be2e3183-2128-44f6-a4c6-5ec06df4d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:17.226891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 882/1760] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:17.227908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e3183-2128-44f6-a4c6-5ec06df4d82a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.229537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-be2e3183-2128-44f6-a4c6-5ec06df4d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:17.326820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344c685-963b-47f8-903a-5c6a59e033a8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.343192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.343850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.344134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.344419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.346871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.355235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.381955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e3183-2128-44f6-a4c6-5ec06df4d82a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.386683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e423-34d7-4290-bfc7-600181279658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.388057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e423-34d7-4290-bfc7-600181279658 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.388542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e423-34d7-4290-bfc7-600181279658 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.389007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e423-34d7-4290-bfc7-600181279658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.403680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5e423-34d7-4290-bfc7-600181279658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.406573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5e423-34d7-4290-bfc7-600181279658 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.442223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 883/1761] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:17.475963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e423-34d7-4290-bfc7-600181279658 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.476802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 879/1762] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:17 2022] POST /identity/v3/projects => generated 401 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:17.504017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.505777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:17.509635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e423-34d7-4290-bfc7-600181279658 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.648602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:17.656763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8328239-12dc-447e-961c-c9c7c95e5387 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.664237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337da91-54d7-4992-9aad-43890b4d80ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.665630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337da91-54d7-4992-9aad-43890b4d80ae service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.666207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337da91-54d7-4992-9aad-43890b4d80ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.666747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337da91-54d7-4992-9aad-43890b4d80ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.678173 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337da91-54d7-4992-9aad-43890b4d80ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.679889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337da91-54d7-4992-9aad-43890b4d80ae service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.696236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 880/1763] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:17.697210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337da91-54d7-4992-9aad-43890b4d80ae service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.719359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff224c-e72e-4ba4-812c-7aa063a7fa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.721071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff224c-e72e-4ba4-812c-7aa063a7fa41 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.721361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff224c-e72e-4ba4-812c-7aa063a7fa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.722956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff224c-e72e-4ba4-812c-7aa063a7fa41 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.734982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff224c-e72e-4ba4-812c-7aa063a7fa41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.740727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff224c-e72e-4ba4-812c-7aa063a7fa41 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.792817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337da91-54d7-4992-9aad-43890b4d80ae service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.797971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e209b7-cca2-48a9-9709-cfdfb3d28bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.802078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 884/1764] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:17 2022] POST /identity/v3/users => generated 307 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:17.802644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e209b7-cca2-48a9-9709-cfdfb3d28bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.802644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e209b7-cca2-48a9-9709-cfdfb3d28bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.802904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e209b7-cca2-48a9-9709-cfdfb3d28bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.804177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff224c-e72e-4ba4-812c-7aa063a7fa41 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.867041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff224c-e72e-4ba4-812c-7aa063a7fa41 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.915439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb6caa-47a2-4e8b-8272-a059881f447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.917573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6caa-47a2-4e8b-8272-a059881f447c admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.918513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6caa-47a2-4e8b-8272-a059881f447c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.918815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6caa-47a2-4e8b-8272-a059881f447c admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.923639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb6caa-47a2-4e8b-8272-a059881f447c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.928302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb6caa-47a2-4e8b-8272-a059881f447c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.938429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:17.977145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 885/1765] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:17.982325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ae0c-b09c-42ed-9e9b-b4578285b3ff None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.983800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ae0c-b09c-42ed-9e9b-b4578285b3ff None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.983800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358ae0c-b09c-42ed-9e9b-b4578285b3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.993343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e209b7-cca2-48a9-9709-cfdfb3d28bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:18.013123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e209b7-cca2-48a9-9709-cfdfb3d28bd1 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:18.082950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-5358ae0c-b09c-42ed-9e9b-b4578285b3ff None None] MFA Rules not processed for user `59499f8f98f9474c8eda196a712d752e`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:18.088225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5358ae0c-b09c-42ed-9e9b-b4578285b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:18.091464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 881/1766] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:18.123578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e209b7-cca2-48a9-9709-cfdfb3d28bd1 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:18.222351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e209b7-cca2-48a9-9709-cfdfb3d28bd1 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:18.287456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01256e9-ce6b-4130-8f25-4e8ce0244e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:18.288078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01256e9-ce6b-4130-8f25-4e8ce0244e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.288372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01256e9-ce6b-4130-8f25-4e8ce0244e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.304846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01256e9-ce6b-4130-8f25-4e8ce0244e24 admin admin] PATH_INFO: `/v3/projects/951312f1680c4d4fb4d0cea27349cd15/users/529612d99b6f482a94f1045c51cb8058/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.374163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01256e9-ce6b-4130-8f25-4e8ce0244e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951312f1680c4d4fb4d0cea27349cd15, user_id=529612d99b6f482a94f1045c51cb8058, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:18.388069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01256e9-ce6b-4130-8f25-4e8ce0244e24 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:18.417387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 882/1767] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:18 2022] PUT /identity/v3/projects/951312f1680c4d4fb4d0cea27349cd15/users/529612d99b6f482a94f1045c51cb8058/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:18.422047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01256e9-ce6b-4130-8f25-4e8ce0244e24 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:18.425582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 886/1768] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:18.540047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4448397-2eae-4f1c-af3c-48f2c8bf98c5 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.547595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4448397-2eae-4f1c-af3c-48f2c8bf98c5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.548026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4448397-2eae-4f1c-af3c-48f2c8bf98c5 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.551276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 887/1769] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:40:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:18.560448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbe47-60da-412e-bb5b-94d8a004635f None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.560765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbe47-60da-412e-bb5b-94d8a004635f None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.561009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fbe47-60da-412e-bb5b-94d8a004635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.588607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01256e9-ce6b-4130-8f25-4e8ce0244e24 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:18.607782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb17b2-ed3b-48a3-93dc-141c03826247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:18.608516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb17b2-ed3b-48a3-93dc-141c03826247 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.609362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb17b2-ed3b-48a3-93dc-141c03826247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.609497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-bc8fbe47-60da-412e-bb5b-94d8a004635f None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:18.609581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb17b2-ed3b-48a3-93dc-141c03826247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.610095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb17b2-ed3b-48a3-93dc-141c03826247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:18.611704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb17b2-ed3b-48a3-93dc-141c03826247 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:18.611819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bc8fbe47-60da-412e-bb5b-94d8a004635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:18.636444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 883/1770] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:40:18.637893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb17b2-ed3b-48a3-93dc-141c03826247 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:18.671397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb17b2-ed3b-48a3-93dc-141c03826247 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:18.696075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dfaa2-79b9-4a76-a542-4aca13d7d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:18.696784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dfaa2-79b9-4a76-a542-4aca13d7d8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.697069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dfaa2-79b9-4a76-a542-4aca13d7d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.697349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dfaa2-79b9-4a76-a542-4aca13d7d8e8 admin admin] PATH_INFO: `/v3/projects/951312f1680c4d4fb4d0cea27349cd15/users/529612d99b6f482a94f1045c51cb8058/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.709515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dfaa2-79b9-4a76-a542-4aca13d7d8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951312f1680c4d4fb4d0cea27349cd15, user_id=529612d99b6f482a94f1045c51cb8058, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:18.711519 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dfaa2-79b9-4a76-a542-4aca13d7d8e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:18.750783 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 884/1771] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:18 2022] PUT /identity/v3/projects/951312f1680c4d4fb4d0cea27349cd15/users/529612d99b6f482a94f1045c51cb8058/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:18.763039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa89379-a60c-47e4-bc3e-10652df43d35 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.763329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa89379-a60c-47e4-bc3e-10652df43d35 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.763611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa89379-a60c-47e4-bc3e-10652df43d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.785812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:18.901869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0fa89379-a60c-47e4-bc3e-10652df43d35 None None] MFA Rules not processed for user `529612d99b6f482a94f1045c51cb8058`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:18.910352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0fa89379-a60c-47e4-bc3e-10652df43d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:18.946729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 888/1772] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:18.949983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d17822-5134-4019-bfac-113156bbc8ac None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.949983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d17822-5134-4019-bfac-113156bbc8ac None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.955170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d17822-5134-4019-bfac-113156bbc8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.091546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-f9d17822-5134-4019-bfac-113156bbc8ac None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:19.094872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f9d17822-5134-4019-bfac-113156bbc8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:19.148516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 885/1773] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:19.149598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa89379-a60c-47e4-bc3e-10652df43d35 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:19.152717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0fa89379-a60c-47e4-bc3e-10652df43d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:19.283924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa89379-a60c-47e4-bc3e-10652df43d35 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:19.300578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13242aa-1361-4aa8-bd9b-612e567f2dcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:19.302745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13242aa-1361-4aa8-bd9b-612e567f2dcb service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.303272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13242aa-1361-4aa8-bd9b-612e567f2dcb service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.303692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13242aa-1361-4aa8-bd9b-612e567f2dcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.329006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13242aa-1361-4aa8-bd9b-612e567f2dcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:19.330705 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13242aa-1361-4aa8-bd9b-612e567f2dcb service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:19.352017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 886/1774] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:19.353078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13242aa-1361-4aa8-bd9b-612e567f2dcb service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:19.408018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 889/1775] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:19.471945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13242aa-1361-4aa8-bd9b-612e567f2dcb service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:19.481827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e547bd-711b-44b6-aed1-90528f46f3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:19.482609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e547bd-711b-44b6-aed1-90528f46f3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.482817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e547bd-711b-44b6-aed1-90528f46f3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.483091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e547bd-711b-44b6-aed1-90528f46f3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.508784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e547bd-711b-44b6-aed1-90528f46f3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:19.510622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e547bd-711b-44b6-aed1-90528f46f3f1 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:19.537538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 887/1776] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:19 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:19.673329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d17822-5134-4019-bfac-113156bbc8ac None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:19.674386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c55bdd-6379-4bbe-a2f9-aee9c7fd71ff None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.674554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c55bdd-6379-4bbe-a2f9-aee9c7fd71ff None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.674900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c55bdd-6379-4bbe-a2f9-aee9c7fd71ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.676300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f9d17822-5134-4019-bfac-113156bbc8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:19.719409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:19.747543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e7c55bdd-6379-4bbe-a2f9-aee9c7fd71ff None None] MFA Rules not processed for user `725058b77fb64ed2a8a31869df3d2a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:19.754719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e7c55bdd-6379-4bbe-a2f9-aee9c7fd71ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:19.814020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:19.889507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d17822-5134-4019-bfac-113156bbc8ac None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:19.901482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:19.903273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.903559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.903835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] PATH_INFO: `/v3/users/c2fd173544f84477b502aa4d2affd150` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.907921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fd173544f84477b502aa4d2affd150)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:19.910003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:19.952625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 888/1777] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:19.953282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c55bdd-6379-4bbe-a2f9-aee9c7fd71ff None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:19.957480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e7c55bdd-6379-4bbe-a2f9-aee9c7fd71ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.043271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fd173544f84477b502aa4d2affd150'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.046917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fd173544f84477b502aa4d2affd150'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.098930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fd173544f84477b502aa4d2affd150'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.130565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fd173544f84477b502aa4d2affd150'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.131354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fd173544f84477b502aa4d2affd150'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.174886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 890/1778] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:19 2022] DELETE /identity/v3/users/c2fd173544f84477b502aa4d2affd150 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:20.175863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:20.180508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.276376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c55bdd-6379-4bbe-a2f9-aee9c7fd71ff None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:20.371151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddbf6d-2b3a-4806-9d1a-f1bfd61959e0 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:20.385360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f12e55-b7ce-4bd4-b89a-384771612e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:20.386020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12e55-b7ce-4bd4-b89a-384771612e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.386301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12e55-b7ce-4bd4-b89a-384771612e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.386573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f12e55-b7ce-4bd4-b89a-384771612e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.395395 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-97f12e55-b7ce-4bd4-b89a-384771612e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.516772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:20.519369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.519976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.521772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.525197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.570878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:20.638511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f12e55-b7ce-4bd4-b89a-384771612e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:20.642314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f12e55-b7ce-4bd4-b89a-384771612e24 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:20.666687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:20.676289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 891/1779] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:20.677634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d2824-f5ac-44c8-9d69-bc8ad13a9776 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.677983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d2824-f5ac-44c8-9d69-bc8ad13a9776 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.678293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d2824-f5ac-44c8-9d69-bc8ad13a9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.707236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:20.712651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:20.742210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 889/1780] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:40:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:40:20.746688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:20.751789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.751999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-702d2824-f5ac-44c8-9d69-bc8ad13a9776 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:20.755112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-702d2824-f5ac-44c8-9d69-bc8ad13a9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:21.118222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 892/1781] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:21.171537 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d070-7933-4003-934e-2224705e5b5d service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:21.213157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:21.213862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:21.214169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:21.214456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] PATH_INFO: `/v3/users/ff4c71e4dd264c78840f600673d63d9d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:21.219829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4c71e4dd264c78840f600673d63d9d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:21.243653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:21.296289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced240-3357-402d-8cef-b8d48f0b6b8c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:21.296585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced240-3357-402d-8cef-b8d48f0b6b8c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:21.296866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced240-3357-402d-8cef-b8d48f0b6b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:21.373511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-31ced240-3357-402d-8cef-b8d48f0b6b8c None None] MFA Rules not processed for user `9962d812513a428b99ada1f79a5b88d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:21.373511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-31ced240-3357-402d-8cef-b8d48f0b6b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:21.569495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4c71e4dd264c78840f600673d63d9d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:21.573411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4c71e4dd264c78840f600673d63d9d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:21.615505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4c71e4dd264c78840f600673d63d9d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:21.670055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 893/1782] 10.222.0.97 () {58 vars in 1015 bytes} [Fri Aug 26 15:40:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:21.672558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ced240-3357-402d-8cef-b8d48f0b6b8c None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:21.679944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4c71e4dd264c78840f600673d63d9d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:21.681514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-31ced240-3357-402d-8cef-b8d48f0b6b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:21.682020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4c71e4dd264c78840f600673d63d9d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:21.714686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ced240-3357-402d-8cef-b8d48f0b6b8c None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:21.728825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:21.729921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:21.731633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:21.733979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:21.740419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:21.779774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:21.785246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:21.790563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 890/1783] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:20 2022] DELETE /identity/v3/users/ff4c71e4dd264c78840f600673d63d9d => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:21.823009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:21.823259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 894/1784] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:22.078943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd29b-c7a3-4cde-83e4-0cea77b8ea5a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:22.094257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9703f00-3ac7-479c-9682-d4e7f186dd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:22.094897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9703f00-3ac7-479c-9682-d4e7f186dd0b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:22.095239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9703f00-3ac7-479c-9682-d4e7f186dd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:22.095476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9703f00-3ac7-479c-9682-d4e7f186dd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:22.112009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9703f00-3ac7-479c-9682-d4e7f186dd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:22.116829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9703f00-3ac7-479c-9682-d4e7f186dd0b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:22.157560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 891/1785] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:23.676162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:23.680074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:23.750107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f4af-2c5f-4f24-b9a6-0c72031ec09c service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:24.116510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:24.118034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:24.119426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:24.120299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] PATH_INFO: `/v3/projects/947efed5669c4c4a844b0d272a126fd1` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:24.135189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=947efed5669c4c4a844b0d272a126fd1)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:24.138873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:24.230292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:24.316533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947efed5669c4c4a844b0d272a126fd1', 'request_id': 'req-bcb05e4e-1e30-4609-81ca-8880033ecdaf'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.340322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947efed5669c4c4a844b0d272a126fd1', 'request_id': 'req-bcb05e4e-1e30-4609-81ca-8880033ecdaf'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.377245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947efed5669c4c4a844b0d272a126fd1', 'request_id': 'req-bcb05e4e-1e30-4609-81ca-8880033ecdaf'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.453372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] The token cache is being invalidate because project 947efed5669c4c4a844b0d272a126fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:24.453672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.459910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.469189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 895/1786] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:23 2022] DELETE /identity/v3/projects/947efed5669c4c4a844b0d272a126fd1 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:24.471193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9703f00-3ac7-479c-9682-d4e7f186dd0b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:24.500436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9703f00-3ac7-479c-9682-d4e7f186dd0b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:24.537942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:24.748609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:24.749345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:24.749648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:24.749991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] PATH_INFO: `/v3/users/d34c9a22f41344f7b66027eb5198035b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:24.751231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34c9a22f41344f7b66027eb5198035b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:24.753413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:24.866024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:24.867733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:24.891587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb05e4e-1e30-4609-81ca-8880033ecdaf admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:24.910667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:24.912530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:24.914873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:24.915772 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] PATH_INFO: `/v3/projects/f7bf5193ad6a4356a211bc5655ef5d20` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:24.920355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7bf5193ad6a4356a211bc5655ef5d20)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:24.927385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:24.969553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34c9a22f41344f7b66027eb5198035b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.970775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34c9a22f41344f7b66027eb5198035b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.010855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34c9a22f41344f7b66027eb5198035b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.025983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34c9a22f41344f7b66027eb5198035b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.026873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34c9a22f41344f7b66027eb5198035b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.058433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 892/1787] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:24 2022] DELETE /identity/v3/users/d34c9a22f41344f7b66027eb5198035b => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:25.173236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7bf5193ad6a4356a211bc5655ef5d20', 'request_id': 'req-17fa0fd3-360c-4ba6-a6f1-f769af621cea'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.184700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7bf5193ad6a4356a211bc5655ef5d20', 'request_id': 'req-17fa0fd3-360c-4ba6-a6f1-f769af621cea'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.203595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7bf5193ad6a4356a211bc5655ef5d20', 'request_id': 'req-17fa0fd3-360c-4ba6-a6f1-f769af621cea'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.231703 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] The token cache is being invalidate because project f7bf5193ad6a4356a211bc5655ef5d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:25.232719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.235852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.239939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 896/1788] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:24 2022] DELETE /identity/v3/projects/f7bf5193ad6a4356a211bc5655ef5d20 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:25.243788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:25.245265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:25.525608 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d69d-8d6e-40ec-9f2c-74988216cb2c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:25.589145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:25.629627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:25.630540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:25.631114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:25.631420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] PATH_INFO: `/v3/users/1f19f53fdb754809b28fe841bb68411a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:25.633551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f19f53fdb754809b28fe841bb68411a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:25.640621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:25.802699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f19f53fdb754809b28fe841bb68411a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.838157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f19f53fdb754809b28fe841bb68411a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.878826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f19f53fdb754809b28fe841bb68411a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.879439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:25.881710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:25.896689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f19f53fdb754809b28fe841bb68411a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.897654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613cffdd-b380-4962-bc86-9e319e44e75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f19f53fdb754809b28fe841bb68411a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.935555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0fd3-360c-4ba6-a6f1-f769af621cea admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:25.946321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 893/1789] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:25 2022] DELETE /identity/v3/users/1f19f53fdb754809b28fe841bb68411a => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:26.156902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.158955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.159739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.160660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] PATH_INFO: `/v3/projects/bf11b46efcc04840b026b6ca891adfc7` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.165406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf11b46efcc04840b026b6ca891adfc7)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.172155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:26.253013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:26.335508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf11b46efcc04840b026b6ca891adfc7', 'request_id': 'req-e18e62a6-2131-4e91-8d15-8d9a17a0823b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:26.348589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf11b46efcc04840b026b6ca891adfc7', 'request_id': 'req-e18e62a6-2131-4e91-8d15-8d9a17a0823b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:26.373678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf11b46efcc04840b026b6ca891adfc7', 'request_id': 'req-e18e62a6-2131-4e91-8d15-8d9a17a0823b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:26.414066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] The token cache is being invalidate because project bf11b46efcc04840b026b6ca891adfc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:26.414332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:26.415005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e18e62a6-2131-4e91-8d15-8d9a17a0823b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:26.434677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693112db-eba2-4a57-9a6d-5c7e67f57bbb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.435215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693112db-eba2-4a57-9a6d-5c7e67f57bbb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.435619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693112db-eba2-4a57-9a6d-5c7e67f57bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.439411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 897/1790] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:25 2022] DELETE /identity/v3/projects/bf11b46efcc04840b026b6ca891adfc7 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:26.470424 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-693112db-eba2-4a57-9a6d-5c7e67f57bbb None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:26.471797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-693112db-eba2-4a57-9a6d-5c7e67f57bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:26.645865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 894/1791] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:26.647698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ad6ec-f6d3-4d8a-b49f-714cf5ad0059 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.647854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ad6ec-f6d3-4d8a-b49f-714cf5ad0059 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.648839 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ad6ec-f6d3-4d8a-b49f-714cf5ad0059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.684559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4d9ad6ec-f6d3-4d8a-b49f-714cf5ad0059 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:26.685814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4d9ad6ec-f6d3-4d8a-b49f-714cf5ad0059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:26.721911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 898/1792] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:26.726315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693112db-eba2-4a57-9a6d-5c7e67f57bbb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.748760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693112db-eba2-4a57-9a6d-5c7e67f57bbb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:26.772463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.772463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.772463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.772724 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.773241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:26.773551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.775543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:26.802121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 895/1793] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:26.802764 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ad6ec-f6d3-4d8a-b49f-714cf5ad0059 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.814740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ad6ec-f6d3-4d8a-b49f-714cf5ad0059 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:26.830946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b257ae-2c5c-476e-87e9-84ea0d48b665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.831616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b257ae-2c5c-476e-87e9-84ea0d48b665 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.831896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b257ae-2c5c-476e-87e9-84ea0d48b665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.832161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b257ae-2c5c-476e-87e9-84ea0d48b665 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.833379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b257ae-2c5c-476e-87e9-84ea0d48b665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.835709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b257ae-2c5c-476e-87e9-84ea0d48b665 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:26.943262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 899/1794] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:26 2022] POST /identity/v3/projects => generated 355 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:26.948062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.970083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c941f-bc5f-4152-9fc1-1026ad8e3e82 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:27.162581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:27.206619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0876fa-abd6-4501-8569-32828f08d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:27.206619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0876fa-abd6-4501-8569-32828f08d4dd admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.206619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0876fa-abd6-4501-8569-32828f08d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.206619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0876fa-abd6-4501-8569-32828f08d4dd admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.207867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0876fa-abd6-4501-8569-32828f08d4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:27.207867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0876fa-abd6-4501-8569-32828f08d4dd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.266506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 896/1795] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:26 2022] POST /identity/v3/users => generated 278 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:27.270568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b257ae-2c5c-476e-87e9-84ea0d48b665 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:27.291947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b257ae-2c5c-476e-87e9-84ea0d48b665 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:27.311562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e708f-81da-4f7d-877d-0e616c2300bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:27.312282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e708f-81da-4f7d-877d-0e616c2300bf admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.312611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e708f-81da-4f7d-877d-0e616c2300bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.312889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e708f-81da-4f7d-877d-0e616c2300bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.313724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e708f-81da-4f7d-877d-0e616c2300bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:27.331842 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e708f-81da-4f7d-877d-0e616c2300bf admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.370533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 900/1796] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:27.378718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0876fa-abd6-4501-8569-32828f08d4dd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:27.405508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0876fa-abd6-4501-8569-32828f08d4dd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:27.424425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadfbd3-4a79-4a66-ad40-ebb51fe779e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:27.425110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadfbd3-4a79-4a66-ad40-ebb51fe779e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.425398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadfbd3-4a79-4a66-ad40-ebb51fe779e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.425672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadfbd3-4a79-4a66-ad40-ebb51fe779e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.426371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadfbd3-4a79-4a66-ad40-ebb51fe779e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:27.428275 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadfbd3-4a79-4a66-ad40-ebb51fe779e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.458761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 897/1797] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:27.463190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e708f-81da-4f7d-877d-0e616c2300bf admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:27.484359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32531ac-1c54-4fff-aaed-78c9f2854eb4 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.485288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32531ac-1c54-4fff-aaed-78c9f2854eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.485779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32531ac-1c54-4fff-aaed-78c9f2854eb4 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.492342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 898/1798] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:40:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:27.498476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e708f-81da-4f7d-877d-0e616c2300bf admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:27.515940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed89483-07fe-41a8-88f3-369c3bb16401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:27.516930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed89483-07fe-41a8-88f3-369c3bb16401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.517433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed89483-07fe-41a8-88f3-369c3bb16401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.517951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed89483-07fe-41a8-88f3-369c3bb16401 admin admin] PATH_INFO: `/v3/projects/618a74d808e643e59d02c105e59c5035/users/00b76c11ce244ecd96454f65cb9641fd/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.525658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098531-6802-4119-98bf-ec19439e4498 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.526220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098531-6802-4119-98bf-ec19439e4498 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.526551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098531-6802-4119-98bf-ec19439e4498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.573586 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed89483-07fe-41a8-88f3-369c3bb16401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618a74d808e643e59d02c105e59c5035, user_id=00b76c11ce244ecd96454f65cb9641fd, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:27.592093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed89483-07fe-41a8-88f3-369c3bb16401 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.611876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a1098531-6802-4119-98bf-ec19439e4498 None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:27.613353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a1098531-6802-4119-98bf-ec19439e4498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:27.629885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 901/1799] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:27 2022] PUT /identity/v3/projects/618a74d808e643e59d02c105e59c5035/users/00b76c11ce244ecd96454f65cb9641fd/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:27.642394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c12e4-ed8b-4587-85f5-ffd99b69c514 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.642948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c12e4-ed8b-4587-85f5-ffd99b69c514 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.643230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c12e4-ed8b-4587-85f5-ffd99b69c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.751031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-240c12e4-ed8b-4587-85f5-ffd99b69c514 None None] MFA Rules not processed for user `00b76c11ce244ecd96454f65cb9641fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:27.757375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-240c12e4-ed8b-4587-85f5-ffd99b69c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:27.899566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 899/1800] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 26 15:40:27.981959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 902/1801] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:27.986888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098531-6802-4119-98bf-ec19439e4498 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.001016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098531-6802-4119-98bf-ec19439e4498 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.206972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.207138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c12e4-ed8b-4587-85f5-ffd99b69c514 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.208272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.209944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.210256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.211775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-240c12e4-ed8b-4587-85f5-ffd99b69c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.213411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.218243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.293576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 900/1802] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/projects => generated 351 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:28.293576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.294177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.398351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:28.432184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecfa89-43cc-48e8-b64c-cd9aa214660c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.433523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:28.444891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.446098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.446875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.447300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] PATH_INFO: `/v3/users/96f9dd61d37a42fe8d36f723282aed6e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.449266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f9dd61d37a42fe8d36f723282aed6e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.453231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.504213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c12e4-ed8b-4587-85f5-ffd99b69c514 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.568828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f9dd61d37a42fe8d36f723282aed6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.571101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f9dd61d37a42fe8d36f723282aed6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.594075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f9dd61d37a42fe8d36f723282aed6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.606388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f9dd61d37a42fe8d36f723282aed6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.607443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f9dd61d37a42fe8d36f723282aed6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.637421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 901/1803] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:28 2022] DELETE /identity/v3/users/96f9dd61d37a42fe8d36f723282aed6e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:28.637421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.638007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.723018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166af3-7d62-436c-a444-c5ee34872237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.725210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166af3-7d62-436c-a444-c5ee34872237 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.725505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166af3-7d62-436c-a444-c5ee34872237 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.728303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166af3-7d62-436c-a444-c5ee34872237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.734990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1a166af3-7d62-436c-a444-c5ee34872237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.770968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166af3-7d62-436c-a444-c5ee34872237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.772865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38909cf4-c6cf-4422-96f1-c5e9db7a00f2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.773103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166af3-7d62-436c-a444-c5ee34872237 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.778367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.779469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.779967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.781356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.782245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.784457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.819109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 902/1804] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:28 2022] POST /identity/v3/users => generated 282 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:28.819109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.819942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.825951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 903/1805] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:28.835465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cce86-6af2-42e7-87c2-af3775543b0e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.836014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cce86-6af2-42e7-87c2-af3775543b0e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.836443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cce86-6af2-42e7-87c2-af3775543b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.837303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76069879-b575-4190-9b76-f21f3da28db2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.844915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.845940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.846340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.846704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] PATH_INFO: `/v3/users/8b0679ba5ad04d4cac7d07e6171197f6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.850197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0679ba5ad04d4cac7d07e6171197f6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.854353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.895991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8e4cce86-6af2-42e7-87c2-af3775543b0e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:28.900175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8e4cce86-6af2-42e7-87c2-af3775543b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.950530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 904/1806] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:28.955056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cce86-6af2-42e7-87c2-af3775543b0e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.963697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:28.970310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0679ba5ad04d4cac7d07e6171197f6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.976223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0679ba5ad04d4cac7d07e6171197f6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.977160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cce86-6af2-42e7-87c2-af3775543b0e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.994358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.995750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.996187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.996636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.998693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.000620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.026122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0679ba5ad04d4cac7d07e6171197f6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:29.030293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 905/1807] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:29.039497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0679ba5ad04d4cac7d07e6171197f6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:29.041568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.042144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0679ba5ad04d4cac7d07e6171197f6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:29.046890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.063697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57741a-e2ba-4d5b-937d-c458e33fc094 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.071234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.072791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.073706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.074431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] PATH_INFO: `/v3/projects/5e5fdcfd169648c1be436940b99aa56e/users/dbd1e278fc0c4c44aca92bc3dceec877/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.095661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5fdcfd169648c1be436940b99aa56e, user_id=dbd1e278fc0c4c44aca92bc3dceec877, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.098912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.119689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 903/1808] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:28 2022] DELETE /identity/v3/users/8b0679ba5ad04d4cac7d07e6171197f6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:29.121317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.126746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.136005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 906/1809] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:29 2022] PUT /identity/v3/projects/5e5fdcfd169648c1be436940b99aa56e/users/dbd1e278fc0c4c44aca92bc3dceec877/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:29.143691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.156169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.278873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd13e8-213e-4459-97e2-2c446ba200ff admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.355359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.355872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.356165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.356447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] PATH_INFO: `/v3/projects/c0bcbeb398a84a1d9b0e3ffa548cfe05` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.357936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bcbeb398a84a1d9b0e3ffa548cfe05)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.360895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.418063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3d3d7-b92e-4cc4-bef8-594681539876 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.442641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bcbeb398a84a1d9b0e3ffa548cfe05', 'request_id': 'req-f15c2c76-e520-4906-8518-641627572f32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:29.464695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bcbeb398a84a1d9b0e3ffa548cfe05', 'request_id': 'req-f15c2c76-e520-4906-8518-641627572f32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:29.482577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bcbeb398a84a1d9b0e3ffa548cfe05', 'request_id': 'req-f15c2c76-e520-4906-8518-641627572f32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:29.501745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:29.525633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] The token cache is being invalidate because project c0bcbeb398a84a1d9b0e3ffa548cfe05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:29.526588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:29.527662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f15c2c76-e520-4906-8518-641627572f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:29.535405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 904/1810] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:29 2022] DELETE /identity/v3/projects/c0bcbeb398a84a1d9b0e3ffa548cfe05 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:29.535405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3329-debb-47b0-85a3-400745f9331c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.535405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3329-debb-47b0-85a3-400745f9331c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.535405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3329-debb-47b0-85a3-400745f9331c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.604856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-260c3329-debb-47b0-85a3-400745f9331c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:29.609310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-260c3329-debb-47b0-85a3-400745f9331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.625476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:29.639443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.642748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.643037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.645434 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.655774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.801569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 905/1811] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:29.805853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3329-debb-47b0-85a3-400745f9331c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.807214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-260c3329-debb-47b0-85a3-400745f9331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.830773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c3329-debb-47b0-85a3-400745f9331c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.837358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff62928-d0e0-4ad1-8367-a1cec4c0e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.840400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62928-d0e0-4ad1-8367-a1cec4c0e6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.840736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62928-d0e0-4ad1-8367-a1cec4c0e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.841079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff62928-d0e0-4ad1-8367-a1cec4c0e6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.843921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff62928-d0e0-4ad1-8367-a1cec4c0e6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.848240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff62928-d0e0-4ad1-8367-a1cec4c0e6f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.871790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.877544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.881500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 906/1812] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:29.885888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d52a7-39b4-4eaf-8804-6f7bcc2dbe61 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.886178 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d52a7-39b4-4eaf-8804-6f7bcc2dbe61 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.886654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d52a7-39b4-4eaf-8804-6f7bcc2dbe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.910462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 907/1813] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:29.911526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.914458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.941428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7ada0-0209-4065-83c7-237dfc0a2377 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.943987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ae7d52a7-39b4-4eaf-8804-6f7bcc2dbe61 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:29.945331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ae7d52a7-39b4-4eaf-8804-6f7bcc2dbe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.953259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7d9b0-51e4-4d46-9a2b-2a40473978c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.953919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7d9b0-51e4-4d46-9a2b-2a40473978c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.954208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7d9b0-51e4-4d46-9a2b-2a40473978c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.955044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7d9b0-51e4-4d46-9a2b-2a40473978c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.967504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 907/1814] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:29.968703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d52a7-39b4-4eaf-8804-6f7bcc2dbe61 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.981035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7d9b0-51e4-4d46-9a2b-2a40473978c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.985143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7d9b0-51e4-4d46-9a2b-2a40473978c9 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.994860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d52a7-39b4-4eaf-8804-6f7bcc2dbe61 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.008538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27d647-6ffe-473a-9272-4dc3ea1a50cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.009267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d647-6ffe-473a-9272-4dc3ea1a50cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.010300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d647-6ffe-473a-9272-4dc3ea1a50cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.010585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d647-6ffe-473a-9272-4dc3ea1a50cc admin admin] PATH_INFO: `/v3/projects/5e5fdcfd169648c1be436940b99aa56e/users/dbd1e278fc0c4c44aca92bc3dceec877/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.015107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 908/1815] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:30.016952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27d647-6ffe-473a-9272-4dc3ea1a50cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5fdcfd169648c1be436940b99aa56e, user_id=dbd1e278fc0c4c44aca92bc3dceec877, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.019319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb9c0-126c-4479-9311-0df37426c074 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.021007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb9c0-126c-4479-9311-0df37426c074 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.021219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8eb9c0-126c-4479-9311-0df37426c074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.024598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27d647-6ffe-473a-9272-4dc3ea1a50cc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.056043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 908/1816] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:29 2022] PUT /identity/v3/projects/5e5fdcfd169648c1be436940b99aa56e/users/dbd1e278fc0c4c44aca92bc3dceec877/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:30.064392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-7f8eb9c0-126c-4479-9311-0df37426c074 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:30.066271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104e487-c40b-40fe-a4d9-81309f57c4ac None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.066563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104e487-c40b-40fe-a4d9-81309f57c4ac None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.066845 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104e487-c40b-40fe-a4d9-81309f57c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.074624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7f8eb9c0-126c-4479-9311-0df37426c074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:30.104205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6104e487-c40b-40fe-a4d9-81309f57c4ac None None] MFA Rules not processed for user `dbd1e278fc0c4c44aca92bc3dceec877`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:30.105553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6104e487-c40b-40fe-a4d9-81309f57c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:30.171024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 909/1817] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:30.175740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8eb9c0-126c-4479-9311-0df37426c074 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.192295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8eb9c0-126c-4479-9311-0df37426c074 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.200336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cebee8-6b2d-4c87-9534-fa1c558a23ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.201198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 909/1818] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:30.202400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebee8-6b2d-4c87-9534-fa1c558a23ab admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.203097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebee8-6b2d-4c87-9534-fa1c558a23ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.203625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebee8-6b2d-4c87-9534-fa1c558a23ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.204479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cebee8-6b2d-4c87-9534-fa1c558a23ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:30.204973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cebee8-6b2d-4c87-9534-fa1c558a23ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.215507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cebee8-6b2d-4c87-9534-fa1c558a23ab admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.215722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104e487-c40b-40fe-a4d9-81309f57c4ac None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.218527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6104e487-c40b-40fe-a4d9-81309f57c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:30.249779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 910/1819] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:30.253129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928979-bbf8-4185-a1fe-19613fca784c None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.253507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928979-bbf8-4185-a1fe-19613fca784c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.254454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928979-bbf8-4185-a1fe-19613fca784c None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.258711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 911/1820] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:40:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:30.259460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81928979-bbf8-4185-a1fe-19613fca784c None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.295110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81928979-bbf8-4185-a1fe-19613fca784c None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.307315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946d02-cd83-4a77-b646-5f116ad60dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.309185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946d02-cd83-4a77-b646-5f116ad60dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.309504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946d02-cd83-4a77-b646-5f116ad60dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.311987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946d02-cd83-4a77-b646-5f116ad60dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.312818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946d02-cd83-4a77-b646-5f116ad60dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.318508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946d02-cd83-4a77-b646-5f116ad60dc4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.373314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104e487-c40b-40fe-a4d9-81309f57c4ac None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.380325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cfbb7-a68e-4248-94c1-1678065ad20e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.380569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cfbb7-a68e-4248-94c1-1678065ad20e service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.380982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cfbb7-a68e-4248-94c1-1678065ad20e service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.381415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cfbb7-a68e-4248-94c1-1678065ad20e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.397447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:30.402564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 912/1821] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:30 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:30.406012 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cfbb7-a68e-4248-94c1-1678065ad20e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.407524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946d02-cd83-4a77-b646-5f116ad60dc4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.409551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cfbb7-a68e-4248-94c1-1678065ad20e service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.440587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 910/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:30 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:30.522491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:30.543375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946d02-cd83-4a77-b646-5f116ad60dc4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.555515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc481-eb99-46da-b85e-a642fa82aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.556218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc481-eb99-46da-b85e-a642fa82aae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.556502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc481-eb99-46da-b85e-a642fa82aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.556668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b4d4-cf13-4619-9478-8c3abf7afeb2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.556767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc481-eb99-46da-b85e-a642fa82aae7 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.557024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b4d4-cf13-4619-9478-8c3abf7afeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.557493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdc481-eb99-46da-b85e-a642fa82aae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.558046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6b4d4-cf13-4619-9478-8c3abf7afeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.559555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdc481-eb99-46da-b85e-a642fa82aae7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.606548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 913/1823] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:30 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:30.607495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc481-eb99-46da-b85e-a642fa82aae7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.627180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f1c6b4d4-cf13-4619-9478-8c3abf7afeb2 None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:30.631383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f1c6b4d4-cf13-4619-9478-8c3abf7afeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:30.725209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc481-eb99-46da-b85e-a642fa82aae7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.770628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.771272 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.771564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.771885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.773758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:30.893219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 911/1824] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:30.896771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b4d4-cf13-4619-9478-8c3abf7afeb2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.949527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6b4d4-cf13-4619-9478-8c3abf7afeb2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.964063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e7f0-a8a7-4709-b822-207cd6bad7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.965202 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e7f0-a8a7-4709-b822-207cd6bad7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.974710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.978703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e7f0-a8a7-4709-b822-207cd6bad7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.980623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66e7f0-a8a7-4709-b822-207cd6bad7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.981692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66e7f0-a8a7-4709-b822-207cd6bad7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.982819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.989270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66e7f0-a8a7-4709-b822-207cd6bad7b9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:31.023960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 914/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:31.026328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:31.037958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:31.041371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 912/1826] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:31.055951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e7f0-a8a7-4709-b822-207cd6bad7b9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:31.086843 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66e7f0-a8a7-4709-b822-207cd6bad7b9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:31.091080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fba38b-d55b-4f1c-965a-9d22fae8a2c1 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:31.102240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fa7c5-c858-4030-94f2-95c74bc40a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:31.102932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fa7c5-c858-4030-94f2-95c74bc40a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.103220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fa7c5-c858-4030-94f2-95c74bc40a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.103499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fa7c5-c858-4030-94f2-95c74bc40a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.104166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fa7c5-c858-4030-94f2-95c74bc40a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:31.110138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fa7c5-c858-4030-94f2-95c74bc40a1f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:31.115921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108ddd6-a4e9-4e78-8d7c-962e31eb727c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:31.116606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ddd6-a4e9-4e78-8d7c-962e31eb727c service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.116886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ddd6-a4e9-4e78-8d7c-962e31eb727c service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.117180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ddd6-a4e9-4e78-8d7c-962e31eb727c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.150193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 913/1827] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:31.153712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fa7c5-c858-4030-94f2-95c74bc40a1f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:31.157964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108ddd6-a4e9-4e78-8d7c-962e31eb727c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:31.162574 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108ddd6-a4e9-4e78-8d7c-962e31eb727c service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:31.176528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fa7c5-c858-4030-94f2-95c74bc40a1f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:31.190145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 915/1828] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:31.192807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef57eb-c459-45fa-acdf-fca93a887a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:31.193640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef57eb-c459-45fa-acdf-fca93a887a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.193976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef57eb-c459-45fa-acdf-fca93a887a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.194145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef57eb-c459-45fa-acdf-fca93a887a20 admin admin] PATH_INFO: `/v3/projects/977db99d4c714dfc9bd3193965c67b00/users/1ed5db672df74026a822a1bdb26d2e86/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.235634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef57eb-c459-45fa-acdf-fca93a887a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=977db99d4c714dfc9bd3193965c67b00, user_id=1ed5db672df74026a822a1bdb26d2e86, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:31.258141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef57eb-c459-45fa-acdf-fca93a887a20 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:31.284104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 914/1829] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:31 2022] PUT /identity/v3/projects/977db99d4c714dfc9bd3193965c67b00/users/1ed5db672df74026a822a1bdb26d2e86/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:31.296696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6f59-ffdb-410d-b06a-056879435bf4 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.297083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6f59-ffdb-410d-b06a-056879435bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.297382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b6f59-ffdb-410d-b06a-056879435bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.399268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-af2b6f59-ffdb-410d-b06a-056879435bf4 None None] MFA Rules not processed for user `1ed5db672df74026a822a1bdb26d2e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:31.401796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-af2b6f59-ffdb-410d-b06a-056879435bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:31.525500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 916/1830] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:31.526570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef57eb-c459-45fa-acdf-fca93a887a20 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:31.651723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b6f59-ffdb-410d-b06a-056879435bf4 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:31.653393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-af2b6f59-ffdb-410d-b06a-056879435bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:31.691565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:31.692775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef57eb-c459-45fa-acdf-fca93a887a20 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:31.701047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893907dd-8687-4548-89a8-6c5c147defaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:31.708740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893907dd-8687-4548-89a8-6c5c147defaa admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.711231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893907dd-8687-4548-89a8-6c5c147defaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.711782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893907dd-8687-4548-89a8-6c5c147defaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.714098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893907dd-8687-4548-89a8-6c5c147defaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:31.718961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893907dd-8687-4548-89a8-6c5c147defaa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:31.825442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 915/1831] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:31 2022] POST /identity/v3/projects => generated 387 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:31.829984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893907dd-8687-4548-89a8-6c5c147defaa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:31.879330 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b6f59-ffdb-410d-b06a-056879435bf4 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:31.925970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:32.013758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893907dd-8687-4548-89a8-6c5c147defaa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:32.027518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0314f30-88d8-45db-8a2e-a796249e3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:32.027875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314f30-88d8-45db-8a2e-a796249e3123 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.028593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314f30-88d8-45db-8a2e-a796249e3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.028870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314f30-88d8-45db-8a2e-a796249e3123 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.029504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0314f30-88d8-45db-8a2e-a796249e3123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:32.031612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0314f30-88d8-45db-8a2e-a796249e3123 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:32.035702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:32.036357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.036639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.036978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] PATH_INFO: `/v3/projects/fd6571253ee742c3afd87b68ae89daf3` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.046795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd6571253ee742c3afd87b68ae89daf3)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:32.052990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:32.107961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 916/1832] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:31 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:32.112673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0314f30-88d8-45db-8a2e-a796249e3123 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:32.152806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0314f30-88d8-45db-8a2e-a796249e3123 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:32.167623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995243da-329c-4381-80a5-139e07a691ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:32.170463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995243da-329c-4381-80a5-139e07a691ef admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.170755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995243da-329c-4381-80a5-139e07a691ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.171100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995243da-329c-4381-80a5-139e07a691ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.171796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995243da-329c-4381-80a5-139e07a691ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:32.178659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995243da-329c-4381-80a5-139e07a691ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:32.210611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 917/1833] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:32.214474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995243da-329c-4381-80a5-139e07a691ef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:32.229997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd6571253ee742c3afd87b68ae89daf3', 'request_id': 'req-43bd6563-f886-40c6-813a-42ad52c1cf86'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.251146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd6571253ee742c3afd87b68ae89daf3', 'request_id': 'req-43bd6563-f886-40c6-813a-42ad52c1cf86'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.259334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995243da-329c-4381-80a5-139e07a691ef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:32.275048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd6571253ee742c3afd87b68ae89daf3', 'request_id': 'req-43bd6563-f886-40c6-813a-42ad52c1cf86'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.312251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] The token cache is being invalidate because project fd6571253ee742c3afd87b68ae89daf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:32.313790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.317569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.321013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 917/1834] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:31 2022] DELETE /identity/v3/projects/fd6571253ee742c3afd87b68ae89daf3 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:32.325537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:32.329947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:32.419579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:32.420209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.420531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.420913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.421574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:32.423363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:32.453991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 918/1835] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:32.457895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:32.468451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:32.505057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8d4a-c7ac-4062-8fc6-40032d4567ec admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:32.513724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:32.525432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d4297-0d84-486d-b11e-28ea20ca00db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:32.526335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4297-0d84-486d-b11e-28ea20ca00db admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.526761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4297-0d84-486d-b11e-28ea20ca00db admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.527175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4297-0d84-486d-b11e-28ea20ca00db admin admin] PATH_INFO: `/v3/projects/1571c1321d4045fdbaac2e95406660d6/users/14344651b1364f76a84dd2ec6f60aff3/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.562148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d4297-0d84-486d-b11e-28ea20ca00db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1571c1321d4045fdbaac2e95406660d6, user_id=14344651b1364f76a84dd2ec6f60aff3, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:32.564596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd6563-f886-40c6-813a-42ad52c1cf86 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:32.567996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d4297-0d84-486d-b11e-28ea20ca00db admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:32.579003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:32.579670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.580009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.580786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] PATH_INFO: `/v3/users/397e09da9f3444d4a033f415d3a08061` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.584988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397e09da9f3444d4a033f415d3a08061)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:32.587362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:32.613358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 919/1836] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:32 2022] PUT /identity/v3/projects/1571c1321d4045fdbaac2e95406660d6/users/14344651b1364f76a84dd2ec6f60aff3/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:32.618117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02116a1-5fdd-46cc-9fac-c1b7a03bfb1b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.618696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02116a1-5fdd-46cc-9fac-c1b7a03bfb1b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.619741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02116a1-5fdd-46cc-9fac-c1b7a03bfb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.683005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a02116a1-5fdd-46cc-9fac-c1b7a03bfb1b None None] MFA Rules not processed for user `14344651b1364f76a84dd2ec6f60aff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:32.685350 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a02116a1-5fdd-46cc-9fac-c1b7a03bfb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:32.755147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397e09da9f3444d4a033f415d3a08061'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.756178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397e09da9f3444d4a033f415d3a08061'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.792200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397e09da9f3444d4a033f415d3a08061'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.805075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397e09da9f3444d4a033f415d3a08061'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.810758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397e09da9f3444d4a033f415d3a08061'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:32.839217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 918/1837] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:32 2022] DELETE /identity/v3/users/397e09da9f3444d4a033f415d3a08061 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:32.881448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 920/1838] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:32.882729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:32.884449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:33.044002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1c015-f970-4845-8c5e-91bd2ef07622 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:33.053775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:33.054814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:33.055687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:33.057608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:33.058767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:33.067004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:33.142184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02116a1-5fdd-46cc-9fac-c1b7a03bfb1b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:33.144051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 919/1839] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:32 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:33.156187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:33.272082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02116a1-5fdd-46cc-9fac-c1b7a03bfb1b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:33.413053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ad43-5247-4b0b-be48-9295fa403add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:33.413803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ad43-5247-4b0b-be48-9295fa403add admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:33.414462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ad43-5247-4b0b-be48-9295fa403add admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:33.415157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28ad43-5247-4b0b-be48-9295fa403add admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:33.415893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28ad43-5247-4b0b-be48-9295fa403add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:33.418761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28ad43-5247-4b0b-be48-9295fa403add admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:33.427519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:33.430287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:33.456179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e106612-95c4-4225-aeb0-3b3b8b42a002 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:33.469229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:33.469940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:33.470222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:33.472022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] PATH_INFO: `/v3/projects/be644cdbd82345889cca136bbb15e5e5` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:33.480702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be644cdbd82345889cca136bbb15e5e5)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:33.483005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:33.499153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 921/1840] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:33 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:33.501942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ad43-5247-4b0b-be48-9295fa403add admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:33.529274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28ad43-5247-4b0b-be48-9295fa403add admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:33.550198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ef52b-9c4d-47a6-bbd7-e6844b2173ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:33.551812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ef52b-9c4d-47a6-bbd7-e6844b2173ef admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:33.551812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ef52b-9c4d-47a6-bbd7-e6844b2173ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:33.552330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ef52b-9c4d-47a6-bbd7-e6844b2173ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:33.553438 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ef52b-9c4d-47a6-bbd7-e6844b2173ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:33.556243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ef52b-9c4d-47a6-bbd7-e6844b2173ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:33.585703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 922/1841] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:33.588567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:33.590543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ef52b-9c4d-47a6-bbd7-e6844b2173ef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:33.593286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be644cdbd82345889cca136bbb15e5e5', 'request_id': 'req-54baeb27-d87a-4417-90c9-4cc2b9962c45'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:33.603207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be644cdbd82345889cca136bbb15e5e5', 'request_id': 'req-54baeb27-d87a-4417-90c9-4cc2b9962c45'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:33.617087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ef52b-9c4d-47a6-bbd7-e6844b2173ef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:33.630008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be644cdbd82345889cca136bbb15e5e5', 'request_id': 'req-54baeb27-d87a-4417-90c9-4cc2b9962c45'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:33.669935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] The token cache is being invalidate because project be644cdbd82345889cca136bbb15e5e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:33.670484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:33.671802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:33.677354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 920/1842] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:33 2022] DELETE /identity/v3/projects/be644cdbd82345889cca136bbb15e5e5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:33.682605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:33.684561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:33.788336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:33.789244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:33.789606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:33.789920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] PATH_INFO: `/v3/projects/e6ba9122010346a3afcff7a19ce501ac/users/c8ccc3f451e8422195bed8c103f109c7/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:33.829901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ba9122010346a3afcff7a19ce501ac, user_id=c8ccc3f451e8422195bed8c103f109c7, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:33.839306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:33.856288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baeb27-d87a-4417-90c9-4cc2b9962c45 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:33.885767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 923/1843] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:33 2022] PUT /identity/v3/projects/e6ba9122010346a3afcff7a19ce501ac/users/c8ccc3f451e8422195bed8c103f109c7/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:33.886938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:33.887832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:33.888802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:33.889621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:33.890587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] PATH_INFO: `/v3/users/529612d99b6f482a94f1045c51cb8058` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:33.892244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:33.893499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529612d99b6f482a94f1045c51cb8058)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:33.898407 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:33.944500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:34.094392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529612d99b6f482a94f1045c51cb8058'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:34.104607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529612d99b6f482a94f1045c51cb8058'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:34.169139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529612d99b6f482a94f1045c51cb8058'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:34.191167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529612d99b6f482a94f1045c51cb8058'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:34.192118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529612d99b6f482a94f1045c51cb8058'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:34.201603 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007d88-a39d-4458-a139-c73f0a26f247 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:34.218545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241c323-5709-4406-9c5d-9d461708f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:34.220229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241c323-5709-4406-9c5d-9d461708f69a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:34.221666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241c323-5709-4406-9c5d-9d461708f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:34.222142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241c323-5709-4406-9c5d-9d461708f69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:34.222487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 921/1844] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:33 2022] DELETE /identity/v3/users/529612d99b6f482a94f1045c51cb8058 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:34.223452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241c323-5709-4406-9c5d-9d461708f69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:34.227097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241c323-5709-4406-9c5d-9d461708f69a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:34.266549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 924/1845] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:34.266757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:34.268388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:34.639415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:34.657907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5999c71-1c79-4a43-af14-1982577d5858 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:34.678768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:34.679464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:34.679753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:34.680025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] PATH_INFO: `/v3/projects/e6ba9122010346a3afcff7a19ce501ac/users/c8ccc3f451e8422195bed8c103f109c7/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:34.684889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ba9122010346a3afcff7a19ce501ac, user_id=c8ccc3f451e8422195bed8c103f109c7, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:34.688138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:34.756737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc479-413b-4823-81be-8d559ba72a9e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:34.756737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc479-413b-4823-81be-8d559ba72a9e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:34.757021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc479-413b-4823-81be-8d559ba72a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:34.760006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 922/1846] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:34 2022] PUT /identity/v3/projects/e6ba9122010346a3afcff7a19ce501ac/users/c8ccc3f451e8422195bed8c103f109c7/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:34.840268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2b9cc479-413b-4823-81be-8d559ba72a9e None None] MFA Rules not processed for user `c8ccc3f451e8422195bed8c103f109c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:34.841462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b9cc479-413b-4823-81be-8d559ba72a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:34.998688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 925/1847] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:35.004202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.011274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.160884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d764789-e1e6-4b70-afa5-8e9a65aa06db admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.174283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.174941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.175318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.175605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.190381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.192406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.206455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 923/1848] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:35.287009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cc479-413b-4823-81be-8d559ba72a9e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.288720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b9cc479-413b-4823-81be-8d559ba72a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.403446 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.406195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.422642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cc479-413b-4823-81be-8d559ba72a9e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.436758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db885379-4ba0-4789-8e10-df396d992500 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.443119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.445168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.446061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.446658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] PATH_INFO: `/v3/projects/15dee189bb5f47b3a32bb45b0c1c7b40` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.448591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15dee189bb5f47b3a32bb45b0c1c7b40)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.454212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.456397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.458299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.458866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.459712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] PATH_INFO: `/v3/projects/951312f1680c4d4fb4d0cea27349cd15` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.462030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951312f1680c4d4fb4d0cea27349cd15)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.464886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.518746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:35.532026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15dee189bb5f47b3a32bb45b0c1c7b40', 'request_id': 'req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.544472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15dee189bb5f47b3a32bb45b0c1c7b40', 'request_id': 'req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.554535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15dee189bb5f47b3a32bb45b0c1c7b40', 'request_id': 'req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.566555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951312f1680c4d4fb4d0cea27349cd15', 'request_id': 'req-ab628caa-3e7e-4074-8b73-eefff28e7491'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.572623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] The token cache is being invalidate because project 15dee189bb5f47b3a32bb45b0c1c7b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:35.573131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.574938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-859507eb-0f3e-4a1e-9bb7-75dd86f66a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.577018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 926/1849] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:35 2022] DELETE /identity/v3/projects/15dee189bb5f47b3a32bb45b0c1c7b40 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:35.580604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951312f1680c4d4fb4d0cea27349cd15', 'request_id': 'req-ab628caa-3e7e-4074-8b73-eefff28e7491'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.582143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311276bb-c5f5-4085-b007-e3634afd2f17 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.582711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311276bb-c5f5-4085-b007-e3634afd2f17 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.583106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311276bb-c5f5-4085-b007-e3634afd2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.595786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951312f1680c4d4fb4d0cea27349cd15', 'request_id': 'req-ab628caa-3e7e-4074-8b73-eefff28e7491'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.620625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-311276bb-c5f5-4085-b007-e3634afd2f17 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:35.620935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] The token cache is being invalidate because project 951312f1680c4d4fb4d0cea27349cd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:35.621207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.622316 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-311276bb-c5f5-4085-b007-e3634afd2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.622444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ab628caa-3e7e-4074-8b73-eefff28e7491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.626833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 924/1850] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:35 2022] DELETE /identity/v3/projects/951312f1680c4d4fb4d0cea27349cd15 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:35.628401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a907e-1ea7-4ab0-8e49-0f283102413a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.628691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a907e-1ea7-4ab0-8e49-0f283102413a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.629504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a907e-1ea7-4ab0-8e49-0f283102413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.658729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-680a907e-1ea7-4ab0-8e49-0f283102413a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:35.663993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-680a907e-1ea7-4ab0-8e49-0f283102413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.710274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 927/1851] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:35.718803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8469399-0c48-4940-b963-77b5b46222fe None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.719804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8469399-0c48-4940-b963-77b5b46222fe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.720099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8469399-0c48-4940-b963-77b5b46222fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.743340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b8469399-0c48-4940-b963-77b5b46222fe None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:35.744899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b8469399-0c48-4940-b963-77b5b46222fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.745496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 925/1852] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:35.754607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 928/1853] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:35.754809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96314c-4d9a-4f5c-9a25-ecc0477b02b1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.755557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96314c-4d9a-4f5c-9a25-ecc0477b02b1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.755899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96314c-4d9a-4f5c-9a25-ecc0477b02b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.759664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8469399-0c48-4940-b963-77b5b46222fe None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.771319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8469399-0c48-4940-b963-77b5b46222fe None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.777507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.778329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.778698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.779282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.780892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:35.781140 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.781256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-0b96314c-4d9a-4f5c-9a25-ecc0477b02b1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:35.782532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0b96314c-4d9a-4f5c-9a25-ecc0477b02b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.783016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.791128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 926/1854] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:35.795116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96314c-4d9a-4f5c-9a25-ecc0477b02b1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.798020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 929/1855] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:35.801308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.805724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96314c-4d9a-4f5c-9a25-ecc0477b02b1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.810934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.811961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.812246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.812518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.813178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:35.813368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751f92-7bca-4eb8-83fe-670fb4a9431f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.813473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.815122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.818199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:35.831671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 927/1856] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:35.835816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8a610-7c18-425c-8e7d-c12c8230aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.836440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8a610-7c18-425c-8e7d-c12c8230aff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.836722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8a610-7c18-425c-8e7d-c12c8230aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.836997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8a610-7c18-425c-8e7d-c12c8230aff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.837202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.837636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8a610-7c18-425c-8e7d-c12c8230aff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.839574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8a610-7c18-425c-8e7d-c12c8230aff6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.848445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66317363-853f-4dd9-8743-e646a19cb35a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.853258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ef19-5b4c-495b-afe9-12d71b33a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.853717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ef19-5b4c-495b-afe9-12d71b33a6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.854038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ef19-5b4c-495b-afe9-12d71b33a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.854317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ef19-5b4c-495b-afe9-12d71b33a6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.854968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400ef19-5b4c-495b-afe9-12d71b33a6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.857035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400ef19-5b4c-495b-afe9-12d71b33a6e5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.882434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 930/1857] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:35.886348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8a610-7c18-425c-8e7d-c12c8230aff6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.894522 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 928/1858] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:35.897137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ef19-5b4c-495b-afe9-12d71b33a6e5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.976987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ef19-5b4c-495b-afe9-12d71b33a6e5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.977147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8a610-7c18-425c-8e7d-c12c8230aff6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.982125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13afb7-3f9d-483a-b795-8b4eb3cf98d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.983394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13afb7-3f9d-483a-b795-8b4eb3cf98d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.983782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13afb7-3f9d-483a-b795-8b4eb3cf98d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.984037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13afb7-3f9d-483a-b795-8b4eb3cf98d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.984553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42640bb5-7fe8-4ff7-a5f1-a813c2dab429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.984732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13afb7-3f9d-483a-b795-8b4eb3cf98d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.986110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42640bb5-7fe8-4ff7-a5f1-a813c2dab429 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.986863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42640bb5-7fe8-4ff7-a5f1-a813c2dab429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.987125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13afb7-3f9d-483a-b795-8b4eb3cf98d2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.987251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42640bb5-7fe8-4ff7-a5f1-a813c2dab429 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.987980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42640bb5-7fe8-4ff7-a5f1-a813c2dab429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.990895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42640bb5-7fe8-4ff7-a5f1-a813c2dab429 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.023131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 929/1859] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:36.028362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42640bb5-7fe8-4ff7-a5f1-a813c2dab429 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.035215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 931/1860] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:36.037830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13afb7-3f9d-483a-b795-8b4eb3cf98d2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.044683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42640bb5-7fe8-4ff7-a5f1-a813c2dab429 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.051324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.053418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.053807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.054269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.055855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.057083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13afb7-3f9d-483a-b795-8b4eb3cf98d2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.058369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.072559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88d249-5be7-45a8-a7de-39f543a5c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.073749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d249-5be7-45a8-a7de-39f543a5c166 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.074214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d249-5be7-45a8-a7de-39f543a5c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.074645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d249-5be7-45a8-a7de-39f543a5c166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.075455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88d249-5be7-45a8-a7de-39f543a5c166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.076125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 930/1861] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:36.077273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.078278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88d249-5be7-45a8-a7de-39f543a5c166 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.079007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:36.105875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 932/1862] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:36.106492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88d249-5be7-45a8-a7de-39f543a5c166 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.115149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:36.121371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88d249-5be7-45a8-a7de-39f543a5c166 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.141754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95625b9-ea3e-438d-942a-1998d9cfdbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.143991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95625b9-ea3e-438d-942a-1998d9cfdbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.145546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95625b9-ea3e-438d-942a-1998d9cfdbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.145546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95625b9-ea3e-438d-942a-1998d9cfdbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.146402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95625b9-ea3e-438d-942a-1998d9cfdbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.149040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95625b9-ea3e-438d-942a-1998d9cfdbbf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.162979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 933/1863] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:36.164152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95625b9-ea3e-438d-942a-1998d9cfdbbf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.177285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8564f9-2831-4084-bbc5-85d849f36f17 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.178337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95625b9-ea3e-438d-942a-1998d9cfdbbf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.188654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72ab2e-4430-4462-aa87-87cb112d059a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.189417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ab2e-4430-4462-aa87-87cb112d059a service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.189975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ab2e-4430-4462-aa87-87cb112d059a service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.190482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ab2e-4430-4462-aa87-87cb112d059a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.192469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-cc72ab2e-4430-4462-aa87-87cb112d059a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:36.194516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6ada-74d1-41d9-af3d-025cc856d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.195073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6ada-74d1-41d9-af3d-025cc856d70b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.195349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6ada-74d1-41d9-af3d-025cc856d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.195623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6ada-74d1-41d9-af3d-025cc856d70b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.196257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef6ada-74d1-41d9-af3d-025cc856d70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.198001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef6ada-74d1-41d9-af3d-025cc856d70b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.215030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 934/1864] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:36.215030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6ada-74d1-41d9-af3d-025cc856d70b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.230769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6ada-74d1-41d9-af3d-025cc856d70b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.237415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4951a67-e7de-4605-babe-c26a0b124c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.238108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4951a67-e7de-4605-babe-c26a0b124c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.238398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4951a67-e7de-4605-babe-c26a0b124c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.238784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4951a67-e7de-4605-babe-c26a0b124c71 admin admin] PATH_INFO: `/v3/projects/b31d605ba70a401994f79e5281709017/users/0e8271f4d1da4e67b3718b42aec88b3d/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.259535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4951a67-e7de-4605-babe-c26a0b124c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d605ba70a401994f79e5281709017, user_id=0e8271f4d1da4e67b3718b42aec88b3d, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.262828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4951a67-e7de-4605-babe-c26a0b124c71 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.281081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72ab2e-4430-4462-aa87-87cb112d059a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.282745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72ab2e-4430-4462-aa87-87cb112d059a service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.284768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 935/1865] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:36 2022] PUT /identity/v3/projects/b31d605ba70a401994f79e5281709017/users/0e8271f4d1da4e67b3718b42aec88b3d/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:36.287407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4951a67-e7de-4605-babe-c26a0b124c71 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.299388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 931/1866] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:36.315231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfbf4-d3aa-4189-a591-ecd118750aca None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.316156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfbf4-d3aa-4189-a591-ecd118750aca None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.317113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bfbf4-d3aa-4189-a591-ecd118750aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.346938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:36.390545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-159bfbf4-d3aa-4189-a591-ecd118750aca None None] MFA Rules not processed for user `0e8271f4d1da4e67b3718b42aec88b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:36.392928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-159bfbf4-d3aa-4189-a591-ecd118750aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:36.416105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4951a67-e7de-4605-babe-c26a0b124c71 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.431882 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dbbba-030f-4ad8-8c52-aa53924510a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.446225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbbba-030f-4ad8-8c52-aa53924510a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.446578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbbba-030f-4ad8-8c52-aa53924510a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.446867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dbbba-030f-4ad8-8c52-aa53924510a3 admin admin] PATH_INFO: `/v3/projects/a49a8ec55cab441a97d9da4a261b73e1/users/e0e7f58b6a2d4ed4837168857a61912f/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.491020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dbbba-030f-4ad8-8c52-aa53924510a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49a8ec55cab441a97d9da4a261b73e1, user_id=e0e7f58b6a2d4ed4837168857a61912f, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.493726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dbbba-030f-4ad8-8c52-aa53924510a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.511968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 932/1867] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:36.517353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bfbf4-d3aa-4189-a591-ecd118750aca None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.540780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bfbf4-d3aa-4189-a591-ecd118750aca None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.541405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 936/1868] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:36 2022] PUT /identity/v3/projects/a49a8ec55cab441a97d9da4a261b73e1/users/e0e7f58b6a2d4ed4837168857a61912f/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:36.546442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d78c9b-d031-4df7-9842-75c2a74c2b22 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.546835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d78c9b-d031-4df7-9842-75c2a74c2b22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.547261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d78c9b-d031-4df7-9842-75c2a74c2b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.604347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-95d78c9b-d031-4df7-9842-75c2a74c2b22 None None] MFA Rules not processed for user `e0e7f58b6a2d4ed4837168857a61912f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:36.605768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-95d78c9b-d031-4df7-9842-75c2a74c2b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:36.674781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9617-1d1b-44ac-a99a-47b73f4d86a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.675514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9617-1d1b-44ac-a99a-47b73f4d86a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.675923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9617-1d1b-44ac-a99a-47b73f4d86a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.676336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9617-1d1b-44ac-a99a-47b73f4d86a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.677003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e9617-1d1b-44ac-a99a-47b73f4d86a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.706623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e9617-1d1b-44ac-a99a-47b73f4d86a0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.718787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 937/1869] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:36.723635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d78c9b-d031-4df7-9842-75c2a74c2b22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.740517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d78c9b-d031-4df7-9842-75c2a74c2b22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.746999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f003-83cc-43b5-b325-e06fb79cb339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.747329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f003-83cc-43b5-b325-e06fb79cb339 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.747616 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f003-83cc-43b5-b325-e06fb79cb339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.747997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f003-83cc-43b5-b325-e06fb79cb339 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.749419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f003-83cc-43b5-b325-e06fb79cb339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.751447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f003-83cc-43b5-b325-e06fb79cb339 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.758068 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 933/1870] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:36 2022] POST /identity/v3/projects => generated 367 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:36.759418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9617-1d1b-44ac-a99a-47b73f4d86a0 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.786504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 938/1871] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:36 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:36.791068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f003-83cc-43b5-b325-e06fb79cb339 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.807650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:36.862404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9617-1d1b-44ac-a99a-47b73f4d86a0 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.898549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f003-83cc-43b5-b325-e06fb79cb339 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.905215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:36.905480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1831b1-9e17-437e-821e-0af2e1e025e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.906876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1831b1-9e17-437e-821e-0af2e1e025e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.907330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1831b1-9e17-437e-821e-0af2e1e025e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.907978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1831b1-9e17-437e-821e-0af2e1e025e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.908794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1831b1-9e17-437e-821e-0af2e1e025e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.911296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1831b1-9e17-437e-821e-0af2e1e025e1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.955744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b37d-1827-4ce0-b0fa-45275c69236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.956623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b37d-1827-4ce0-b0fa-45275c69236f admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.957229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b37d-1827-4ce0-b0fa-45275c69236f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.957392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 939/1872] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:36 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:36.957821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b37d-1827-4ce0-b0fa-45275c69236f admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.959280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060b37d-1827-4ce0-b0fa-45275c69236f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.962355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060b37d-1827-4ce0-b0fa-45275c69236f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.962485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1831b1-9e17-437e-821e-0af2e1e025e1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.976713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1831b1-9e17-437e-821e-0af2e1e025e1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.983601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc4b7-aabb-47ed-82c0-d647fd3adf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.984236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc4b7-aabb-47ed-82c0-d647fd3adf3e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.984518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc4b7-aabb-47ed-82c0-d647fd3adf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.984789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc4b7-aabb-47ed-82c0-d647fd3adf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.985442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcc4b7-aabb-47ed-82c0-d647fd3adf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.999653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcc4b7-aabb-47ed-82c0-d647fd3adf3e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.000008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 940/1873] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:37.005553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc4b7-aabb-47ed-82c0-d647fd3adf3e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.008733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 934/1874] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:36 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:37.013536 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b37d-1827-4ce0-b0fa-45275c69236f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.018226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc4b7-aabb-47ed-82c0-d647fd3adf3e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.025653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194da73-22b7-4d20-8fc4-dc53e664f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.026442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194da73-22b7-4d20-8fc4-dc53e664f627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.026800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194da73-22b7-4d20-8fc4-dc53e664f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.027153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194da73-22b7-4d20-8fc4-dc53e664f627 admin admin] PATH_INFO: `/v3/projects/ab3d3b2ebd24404d94cae9f30a337b5f/users/87ddf452021f495f85a5778b5f89e85c/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.028599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b37d-1827-4ce0-b0fa-45275c69236f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.034948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6ca2-adf6-4b70-855a-ee1d83130a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.035676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6ca2-adf6-4b70-855a-ee1d83130a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.036026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6ca2-adf6-4b70-855a-ee1d83130a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.036381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6ca2-adf6-4b70-855a-ee1d83130a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.037093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b6ca2-adf6-4b70-855a-ee1d83130a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.038845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b6ca2-adf6-4b70-855a-ee1d83130a84 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.051271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 935/1875] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:40:37.054922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6ca2-adf6-4b70-855a-ee1d83130a84 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.055948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194da73-22b7-4d20-8fc4-dc53e664f627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3d3b2ebd24404d94cae9f30a337b5f, user_id=87ddf452021f495f85a5778b5f89e85c, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.058785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194da73-22b7-4d20-8fc4-dc53e664f627 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.067553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6ca2-adf6-4b70-855a-ee1d83130a84 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.078163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 941/1876] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:37 2022] PUT /identity/v3/projects/ab3d3b2ebd24404d94cae9f30a337b5f/users/87ddf452021f495f85a5778b5f89e85c/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:37.082157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194da73-22b7-4d20-8fc4-dc53e664f627 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.177057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b744b-3f73-4b78-9c91-de979e7046d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.178332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b744b-3f73-4b78-9c91-de979e7046d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.179910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b744b-3f73-4b78-9c91-de979e7046d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.180439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b744b-3f73-4b78-9c91-de979e7046d3 admin admin] PATH_INFO: `/v3/projects/21dbb3cb449840349c67a51f22825f06/users/87b4cc49e5fc49989b7cdba99c02146e/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.210349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b744b-3f73-4b78-9c91-de979e7046d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21dbb3cb449840349c67a51f22825f06, user_id=87b4cc49e5fc49989b7cdba99c02146e, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.214090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b744b-3f73-4b78-9c91-de979e7046d3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.228083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194da73-22b7-4d20-8fc4-dc53e664f627 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.237552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 936/1877] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:37 2022] PUT /identity/v3/projects/21dbb3cb449840349c67a51f22825f06/users/87b4cc49e5fc49989b7cdba99c02146e/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:37.238862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b744b-3f73-4b78-9c91-de979e7046d3 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.310292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83987fc-c1da-4c2f-b7ca-342499f027f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.311848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83987fc-c1da-4c2f-b7ca-342499f027f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.312458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83987fc-c1da-4c2f-b7ca-342499f027f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.312858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83987fc-c1da-4c2f-b7ca-342499f027f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.314020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83987fc-c1da-4c2f-b7ca-342499f027f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.317964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83987fc-c1da-4c2f-b7ca-342499f027f1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.319127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b744b-3f73-4b78-9c91-de979e7046d3 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.325932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8c7ad-362f-4e17-883d-26e8812c5d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.326788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8c7ad-362f-4e17-883d-26e8812c5d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.327203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8c7ad-362f-4e17-883d-26e8812c5d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.327481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8c7ad-362f-4e17-883d-26e8812c5d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.328157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8c7ad-362f-4e17-883d-26e8812c5d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.331140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8c7ad-362f-4e17-883d-26e8812c5d9c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.340286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 942/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:37.341380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83987fc-c1da-4c2f-b7ca-342499f027f1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.345317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 937/1879] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:37.346389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8c7ad-362f-4e17-883d-26e8812c5d9c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.354235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83987fc-c1da-4c2f-b7ca-342499f027f1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.362719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8c7ad-362f-4e17-883d-26e8812c5d9c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.362939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf42165-1314-4892-98db-1086d23b5ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.363148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf42165-1314-4892-98db-1086d23b5ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.363471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf42165-1314-4892-98db-1086d23b5ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.363814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf42165-1314-4892-98db-1086d23b5ae1 admin admin] PATH_INFO: `/v3/projects/ab3d3b2ebd24404d94cae9f30a337b5f/users/87ddf452021f495f85a5778b5f89e85c/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.366563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf42165-1314-4892-98db-1086d23b5ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3d3b2ebd24404d94cae9f30a337b5f, user_id=87ddf452021f495f85a5778b5f89e85c, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.369228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aff116-bf78-46b7-baf5-6da4123db9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.370106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff116-bf78-46b7-baf5-6da4123db9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.370381 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf42165-1314-4892-98db-1086d23b5ae1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.370528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff116-bf78-46b7-baf5-6da4123db9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.371735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff116-bf78-46b7-baf5-6da4123db9f9 admin admin] PATH_INFO: `/v3/projects/21dbb3cb449840349c67a51f22825f06/users/87b4cc49e5fc49989b7cdba99c02146e/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.374471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aff116-bf78-46b7-baf5-6da4123db9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21dbb3cb449840349c67a51f22825f06, user_id=87b4cc49e5fc49989b7cdba99c02146e, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.375090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:37.379671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aff116-bf78-46b7-baf5-6da4123db9f9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.392951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 943/1880] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:37 2022] PUT /identity/v3/projects/ab3d3b2ebd24404d94cae9f30a337b5f/users/87ddf452021f495f85a5778b5f89e85c/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:37.407203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 938/1881] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:37 2022] PUT /identity/v3/projects/21dbb3cb449840349c67a51f22825f06/users/87b4cc49e5fc49989b7cdba99c02146e/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:37.407386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf0be-4fec-474a-8664-398b5e2a9392 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.407989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf0be-4fec-474a-8664-398b5e2a9392 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.408272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbf0be-4fec-474a-8664-398b5e2a9392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.411611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079967b-1d7f-4599-96b2-03d5ac136a59 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.411887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079967b-1d7f-4599-96b2-03d5ac136a59 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.414032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079967b-1d7f-4599-96b2-03d5ac136a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.449910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:37.455904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4079967b-1d7f-4599-96b2-03d5ac136a59 None None] MFA Rules not processed for user `87b4cc49e5fc49989b7cdba99c02146e`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:37.457585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4079967b-1d7f-4599-96b2-03d5ac136a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:37.464546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4fcbf0be-4fec-474a-8664-398b5e2a9392 None None] MFA Rules not processed for user `87ddf452021f495f85a5778b5f89e85c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:37.465766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4fcbf0be-4fec-474a-8664-398b5e2a9392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:37.554719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 944/1882] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:37.568816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf0be-4fec-474a-8664-398b5e2a9392 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.570382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 939/1883] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:37.571575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4fcbf0be-4fec-474a-8664-398b5e2a9392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:37.586720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079967b-1d7f-4599-96b2-03d5ac136a59 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.662431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbf0be-4fec-474a-8664-398b5e2a9392 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.666512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.667138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.667421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.667698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.693553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079967b-1d7f-4599-96b2-03d5ac136a59 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.699321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f84a9-ca7c-4548-8da3-88f095c98214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.700258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f84a9-ca7c-4548-8da3-88f095c98214 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.700258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f84a9-ca7c-4548-8da3-88f095c98214 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.700601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f84a9-ca7c-4548-8da3-88f095c98214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.714248 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f84a9-ca7c-4548-8da3-88f095c98214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.718131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f84a9-ca7c-4548-8da3-88f095c98214 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.745942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 940/1884] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:37.751574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.753242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.766979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 945/1885] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:37.852833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f84a9-ca7c-4548-8da3-88f095c98214 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.864493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f84a9-ca7c-4548-8da3-88f095c98214 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.868641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e67d5-7f59-4945-a092-39f05d2a326e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.869460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e67d5-7f59-4945-a092-39f05d2a326e service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.869816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e67d5-7f59-4945-a092-39f05d2a326e service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.870235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e67d5-7f59-4945-a092-39f05d2a326e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.942136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e67d5-7f59-4945-a092-39f05d2a326e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.943726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e67d5-7f59-4945-a092-39f05d2a326e service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.954008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 941/1886] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:38.830273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:38.832524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:38.895984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:38.957991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb66eb9-53a2-4bfa-a6dc-e5a89bc19478 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:38.965823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546183-1681-4203-b102-1256432a68fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:38.966843 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546183-1681-4203-b102-1256432a68fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:38.967984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546183-1681-4203-b102-1256432a68fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:38.968419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546183-1681-4203-b102-1256432a68fa admin admin] PATH_INFO: `/v3/users/ec3ef9ebbe2e4f30a811eef526bf9a86` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:38.969916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83546183-1681-4203-b102-1256432a68fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3ef9ebbe2e4f30a811eef526bf9a86)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:38.972058 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83546183-1681-4203-b102-1256432a68fa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:39.044135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-83546183-1681-4203-b102-1256432a68fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3ef9ebbe2e4f30a811eef526bf9a86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.044810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-83546183-1681-4203-b102-1256432a68fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3ef9ebbe2e4f30a811eef526bf9a86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.059170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-83546183-1681-4203-b102-1256432a68fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3ef9ebbe2e4f30a811eef526bf9a86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.071293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-83546183-1681-4203-b102-1256432a68fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3ef9ebbe2e4f30a811eef526bf9a86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.071816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-83546183-1681-4203-b102-1256432a68fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3ef9ebbe2e4f30a811eef526bf9a86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.088470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 946/1887] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:38 2022] DELETE /identity/v3/users/ec3ef9ebbe2e4f30a811eef526bf9a86 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:39.094342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adb959-4568-4677-893b-cfb5540b7150 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:39.094795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adb959-4568-4677-893b-cfb5540b7150 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:39.094902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adb959-4568-4677-893b-cfb5540b7150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:39.130831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-95adb959-4568-4677-893b-cfb5540b7150 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:39.151285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-95adb959-4568-4677-893b-cfb5540b7150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:39.203623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:39.233781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 942/1888] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:39.244053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546183-1681-4203-b102-1256432a68fa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:39.245505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83546183-1681-4203-b102-1256432a68fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:39.315318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546183-1681-4203-b102-1256432a68fa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:39.331998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c14eb-3688-47e1-91ed-f5e00be03dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:39.332408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c14eb-3688-47e1-91ed-f5e00be03dfb service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:39.332772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c14eb-3688-47e1-91ed-f5e00be03dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:39.333114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c14eb-3688-47e1-91ed-f5e00be03dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:39.350096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c14eb-3688-47e1-91ed-f5e00be03dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:39.351609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c14eb-3688-47e1-91ed-f5e00be03dfb service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:39.366684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 947/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:39.819696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adb959-4568-4677-893b-cfb5540b7150 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:39.823315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-95adb959-4568-4677-893b-cfb5540b7150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:39.853834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adb959-4568-4677-893b-cfb5540b7150 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:39.861189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:39.861955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:39.862246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:39.862693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] PATH_INFO: `/v3/projects/dfd9e207851e4e949941fc71c8fbecbe` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:39.863983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd9e207851e4e949941fc71c8fbecbe)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:39.866988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:39.933094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd9e207851e4e949941fc71c8fbecbe', 'request_id': 'req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.945607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd9e207851e4e949941fc71c8fbecbe', 'request_id': 'req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.957363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd9e207851e4e949941fc71c8fbecbe', 'request_id': 'req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.971790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] The token cache is being invalidate because project dfd9e207851e4e949941fc71c8fbecbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:39.971790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.973185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.975183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 943/1890] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:39 2022] DELETE /identity/v3/projects/dfd9e207851e4e949941fc71c8fbecbe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:39.981094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c14eb-3688-47e1-91ed-f5e00be03dfb service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:40.003214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c14eb-3688-47e1-91ed-f5e00be03dfb service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:40.091896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:40.112998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:40.112998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:40.112998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:40.112998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] PATH_INFO: `/v3/users/827de488ca6545b2a00a559d0a2e7468` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:40.113638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827de488ca6545b2a00a559d0a2e7468)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:40.113638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:40.238982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827de488ca6545b2a00a559d0a2e7468'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.242421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827de488ca6545b2a00a559d0a2e7468'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.258569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827de488ca6545b2a00a559d0a2e7468'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.272672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827de488ca6545b2a00a559d0a2e7468'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.274864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827de488ca6545b2a00a559d0a2e7468'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.309542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 948/1891] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:39 2022] DELETE /identity/v3/users/827de488ca6545b2a00a559d0a2e7468 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:40.601258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:40.602804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:40.687689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23f8ac-ce26-489b-8ed4-a3dd8503f726 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:40.735968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:40.737788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:40.760015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2eb7d-8218-404e-8516-c1817ee35a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:40.760760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2eb7d-8218-404e-8516-c1817ee35a7c service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:40.761251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2eb7d-8218-404e-8516-c1817ee35a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:40.761888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2eb7d-8218-404e-8516-c1817ee35a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:40.765148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-96d2eb7d-8218-404e-8516-c1817ee35a7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:40.809559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:40.824842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa2a1-caa4-41bf-92f8-5864e8dc8068 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:40.830869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:40.831622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:40.831975 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:40.832322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] PATH_INFO: `/v3/projects/e41432bf6d6f4f34b37598b1e0772c54` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:40.833556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41432bf6d6f4f34b37598b1e0772c54)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:40.835670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:40.852207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2eb7d-8218-404e-8516-c1817ee35a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:40.853684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2eb7d-8218-404e-8516-c1817ee35a7c service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:40.866237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 944/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:40.915139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41432bf6d6f4f34b37598b1e0772c54', 'request_id': 'req-9150fd7a-5d93-4998-899e-e248e5380733'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.927124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41432bf6d6f4f34b37598b1e0772c54', 'request_id': 'req-9150fd7a-5d93-4998-899e-e248e5380733'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.940348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41432bf6d6f4f34b37598b1e0772c54', 'request_id': 'req-9150fd7a-5d93-4998-899e-e248e5380733'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.960943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] The token cache is being invalidate because project e41432bf6d6f4f34b37598b1e0772c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:40.961455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.962962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9150fd7a-5d93-4998-899e-e248e5380733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.965245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 949/1893] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:40 2022] DELETE /identity/v3/projects/e41432bf6d6f4f34b37598b1e0772c54 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:40.970149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77d33-1134-4fc1-b314-7d88e56581b3 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:40.970668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77d33-1134-4fc1-b314-7d88e56581b3 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:40.970946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c77d33-1134-4fc1-b314-7d88e56581b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.006836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-24c77d33-1134-4fc1-b314-7d88e56581b3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:41.008253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-24c77d33-1134-4fc1-b314-7d88e56581b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:41.114014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 945/1894] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:41.139643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268777a0-e63e-4326-b37f-6a14f338a880 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.146222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268777a0-e63e-4326-b37f-6a14f338a880 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.146590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268777a0-e63e-4326-b37f-6a14f338a880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.156887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:41.176126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-268777a0-e63e-4326-b37f-6a14f338a880 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:41.177414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-268777a0-e63e-4326-b37f-6a14f338a880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:41.190621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 950/1895] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:41.193137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c77d33-1134-4fc1-b314-7d88e56581b3 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.208465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c77d33-1134-4fc1-b314-7d88e56581b3 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.217563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.218240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.218573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.218794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.219593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:41.219904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.222116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.242883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 946/1896] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:41.246970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268777a0-e63e-4326-b37f-6a14f338a880 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.265285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268777a0-e63e-4326-b37f-6a14f338a880 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.280450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7faf7-df4b-49e8-b82b-a05a575063cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.281520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7faf7-df4b-49e8-b82b-a05a575063cf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.281813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7faf7-df4b-49e8-b82b-a05a575063cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.282182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7faf7-df4b-49e8-b82b-a05a575063cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.283053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7faf7-df4b-49e8-b82b-a05a575063cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.287029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7faf7-df4b-49e8-b82b-a05a575063cf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.349742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 951/1897] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:41 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:41.357711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.370489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069c8fb-0fa0-40a7-b001-a4e6c484e7fa admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.524828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb0b4-bf9b-4cd4-b658-c430d184c3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.525722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb0b4-bf9b-4cd4-b658-c430d184c3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.527833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb0b4-bf9b-4cd4-b658-c430d184c3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.528213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feb0b4-bf9b-4cd4-b658-c430d184c3fb admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.529263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb0b4-bf9b-4cd4-b658-c430d184c3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.533317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feb0b4-bf9b-4cd4-b658-c430d184c3fb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.610697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 947/1898] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:41 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:41.615360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7faf7-df4b-49e8-b82b-a05a575063cf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.629252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7faf7-df4b-49e8-b82b-a05a575063cf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.635987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.636715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.637156 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.637436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.638394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.641650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.653673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 952/1899] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:41.657653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb0b4-bf9b-4cd4-b658-c430d184c3fb admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.680738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.682504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:41.693652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feb0b4-bf9b-4cd4-b658-c430d184c3fb admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.706176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090abc7-40d5-4586-b7ea-65d05b424022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.707529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090abc7-40d5-4586-b7ea-65d05b424022 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.707881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090abc7-40d5-4586-b7ea-65d05b424022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.708158 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090abc7-40d5-4586-b7ea-65d05b424022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.708816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090abc7-40d5-4586-b7ea-65d05b424022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.713740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090abc7-40d5-4586-b7ea-65d05b424022 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.737897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 948/1900] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:40:41.739354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090abc7-40d5-4586-b7ea-65d05b424022 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.762652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090abc7-40d5-4586-b7ea-65d05b424022 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.782721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39079792-8dd9-4185-a791-efe04ff87319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.783401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39079792-8dd9-4185-a791-efe04ff87319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.783690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39079792-8dd9-4185-a791-efe04ff87319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.783949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39079792-8dd9-4185-a791-efe04ff87319 admin admin] PATH_INFO: `/v3/projects/cef27d68d89d4cc286628b52d6bf57ac/users/5ed3a1a1fc964f3fa8004b86abff9ed5/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.802440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800874ca-3c0a-4cea-b9a4-2979142ddd55 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.807246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.807915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.808201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.809049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.812257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:41.817411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39079792-8dd9-4185-a791-efe04ff87319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef27d68d89d4cc286628b52d6bf57ac, user_id=5ed3a1a1fc964f3fa8004b86abff9ed5, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.820321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39079792-8dd9-4185-a791-efe04ff87319 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.849400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 949/1901] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:41 2022] PUT /identity/v3/projects/cef27d68d89d4cc286628b52d6bf57ac/users/5ed3a1a1fc964f3fa8004b86abff9ed5/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:41.861280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600b5b-8fdd-4e26-9741-e89ebb4db948 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.862004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600b5b-8fdd-4e26-9741-e89ebb4db948 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.863356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600b5b-8fdd-4e26-9741-e89ebb4db948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.894984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:41.898354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.900041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.915412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-45600b5b-8fdd-4e26-9741-e89ebb4db948 None None] MFA Rules not processed for user `5ed3a1a1fc964f3fa8004b86abff9ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:41.916645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-45600b5b-8fdd-4e26-9741-e89ebb4db948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:41.917340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 953/1902] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:42.066906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 950/1903] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:42.071141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.085819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d3dbd-fddb-486d-8c82-b60268fe3cd0 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.205778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de6544-b49d-4b82-bbc2-822508d648ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.206554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de6544-b49d-4b82-bbc2-822508d648ba admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.206940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de6544-b49d-4b82-bbc2-822508d648ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.207310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de6544-b49d-4b82-bbc2-822508d648ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.208473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de6544-b49d-4b82-bbc2-822508d648ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:42.211795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de6544-b49d-4b82-bbc2-822508d648ba admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:42.266814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 954/1904] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:42 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:42.270885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45600b5b-8fdd-4e26-9741-e89ebb4db948 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.287611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45600b5b-8fdd-4e26-9741-e89ebb4db948 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.374341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed17aa-2759-4118-b55c-2196bbb56d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.375614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed17aa-2759-4118-b55c-2196bbb56d68 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.376185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed17aa-2759-4118-b55c-2196bbb56d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.376496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed17aa-2759-4118-b55c-2196bbb56d68 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.377345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed17aa-2759-4118-b55c-2196bbb56d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:42.379938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed17aa-2759-4118-b55c-2196bbb56d68 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:42.413719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 951/1905] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:42 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:42.416205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de6544-b49d-4b82-bbc2-822508d648ba admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.422891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:42.427624 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de6544-b49d-4b82-bbc2-822508d648ba admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.434447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06062004-a751-4513-91c4-9c4f351d23fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.435151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062004-a751-4513-91c4-9c4f351d23fb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.435563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062004-a751-4513-91c4-9c4f351d23fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.436429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062004-a751-4513-91c4-9c4f351d23fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.437224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06062004-a751-4513-91c4-9c4f351d23fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:42.438964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06062004-a751-4513-91c4-9c4f351d23fb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:42.450357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 955/1906] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:40:42.455392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed17aa-2759-4118-b55c-2196bbb56d68 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.481627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed17aa-2759-4118-b55c-2196bbb56d68 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.492091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89a63b-2ad4-46dc-875b-047f86c69ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.492927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a63b-2ad4-46dc-875b-047f86c69ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.493285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a63b-2ad4-46dc-875b-047f86c69ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.494072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89a63b-2ad4-46dc-875b-047f86c69ea1 admin admin] PATH_INFO: `/v3/projects/8f28940374c74de2a9a4b12bcb591017/users/334864ca5ebf447887cccb52059e7112/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.516041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a63b-2ad4-46dc-875b-047f86c69ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f28940374c74de2a9a4b12bcb591017, user_id=334864ca5ebf447887cccb52059e7112, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:42.519914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89a63b-2ad4-46dc-875b-047f86c69ea1 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:42.540219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 952/1907] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:42 2022] PUT /identity/v3/projects/8f28940374c74de2a9a4b12bcb591017/users/334864ca5ebf447887cccb52059e7112/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:42.559524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06062004-a751-4513-91c4-9c4f351d23fb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.581938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06062004-a751-4513-91c4-9c4f351d23fb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.633368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4f56-b872-438a-99d0-ab985942da69 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.633928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4f56-b872-438a-99d0-ab985942da69 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.633928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f4f56-b872-438a-99d0-ab985942da69 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.635435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 953/1908] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:42.651102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977764e4-502b-487c-9e6b-0822be40343e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.652013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977764e4-502b-487c-9e6b-0822be40343e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.652661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977764e4-502b-487c-9e6b-0822be40343e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.684148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df582227-5dd2-441e-94b8-55a1b81441f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.684677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-977764e4-502b-487c-9e6b-0822be40343e None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:42.685046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582227-5dd2-441e-94b8-55a1b81441f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.685333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582227-5dd2-441e-94b8-55a1b81441f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.685642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582227-5dd2-441e-94b8-55a1b81441f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.686602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df582227-5dd2-441e-94b8-55a1b81441f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:42.686911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-977764e4-502b-487c-9e6b-0822be40343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:42.688723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df582227-5dd2-441e-94b8-55a1b81441f3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:42.715175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 956/1909] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:42.716329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df582227-5dd2-441e-94b8-55a1b81441f3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.730193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df582227-5dd2-441e-94b8-55a1b81441f3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.742266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bc6dd-8777-458c-b344-7d86d4d77a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.742956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc6dd-8777-458c-b344-7d86d4d77a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.743253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc6dd-8777-458c-b344-7d86d4d77a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.743535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc6dd-8777-458c-b344-7d86d4d77a87 admin admin] PATH_INFO: `/v3/projects/8f28940374c74de2a9a4b12bcb591017/users/334864ca5ebf447887cccb52059e7112/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.751038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bc6dd-8777-458c-b344-7d86d4d77a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f28940374c74de2a9a4b12bcb591017, user_id=334864ca5ebf447887cccb52059e7112, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:42.754104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bc6dd-8777-458c-b344-7d86d4d77a87 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:42.771238 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:42.784902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 957/1910] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:42 2022] PUT /identity/v3/projects/8f28940374c74de2a9a4b12bcb591017/users/334864ca5ebf447887cccb52059e7112/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:42.793808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 954/1911] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:42.796365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8932-b69e-4086-8ae5-95b7bb5f64dc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.797823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8932-b69e-4086-8ae5-95b7bb5f64dc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.798152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8932-b69e-4086-8ae5-95b7bb5f64dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.839147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a98f8932-b69e-4086-8ae5-95b7bb5f64dc None None] MFA Rules not processed for user `334864ca5ebf447887cccb52059e7112`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:42.841634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a98f8932-b69e-4086-8ae5-95b7bb5f64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:42.854061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977764e4-502b-487c-9e6b-0822be40343e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.856183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-977764e4-502b-487c-9e6b-0822be40343e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:42.887110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977764e4-502b-487c-9e6b-0822be40343e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:43.068913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 958/1912] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:43.082289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020d4c-156d-4efc-9915-f4f245c5e0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:43.083282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020d4c-156d-4efc-9915-f4f245c5e0c0 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:43.083720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020d4c-156d-4efc-9915-f4f245c5e0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:43.084190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020d4c-156d-4efc-9915-f4f245c5e0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.103595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f8932-b69e-4086-8ae5-95b7bb5f64dc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:43.105047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a98f8932-b69e-4086-8ae5-95b7bb5f64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:43.109460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce020d4c-156d-4efc-9915-f4f245c5e0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:43.112701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce020d4c-156d-4efc-9915-f4f245c5e0c0 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:43.158465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 955/1913] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:43.215855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f8932-b69e-4086-8ae5-95b7bb5f64dc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:43.220368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:43.221049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:43.221984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:43.222271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.257953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:43.259953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:43.278217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 959/1914] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:43.530608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020d4c-156d-4efc-9915-f4f245c5e0c0 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:43.539816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020d4c-156d-4efc-9915-f4f245c5e0c0 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:43.544193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbd8d6-a1ec-432e-a8b2-f24f568e5d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:43.544882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbd8d6-a1ec-432e-a8b2-f24f568e5d91 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:43.545693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbd8d6-a1ec-432e-a8b2-f24f568e5d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:43.545996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbd8d6-a1ec-432e-a8b2-f24f568e5d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.638987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbd8d6-a1ec-432e-a8b2-f24f568e5d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:43.641277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbd8d6-a1ec-432e-a8b2-f24f568e5d91 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:43.656713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 956/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:45.082598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:45.084096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:45.093447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:45.210429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642bf30-d731-49b4-a7ae-76d54ff10662 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:45.221670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:45.222659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.224572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.225119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] PATH_INFO: `/v3/users/1ed5db672df74026a822a1bdb26d2e86` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.226904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed5db672df74026a822a1bdb26d2e86)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:45.230956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:45.345332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed5db672df74026a822a1bdb26d2e86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.346394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed5db672df74026a822a1bdb26d2e86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.365798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed5db672df74026a822a1bdb26d2e86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.384310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed5db672df74026a822a1bdb26d2e86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.385121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed5db672df74026a822a1bdb26d2e86'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.418764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 960/1916] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:45 2022] DELETE /identity/v3/users/1ed5db672df74026a822a1bdb26d2e86 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:45.424090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b076-6874-40e2-ba1e-e0107eb18bf0 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.424542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b076-6874-40e2-ba1e-e0107eb18bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.424642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b076-6874-40e2-ba1e-e0107eb18bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.446560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-a8c3b076-6874-40e2-ba1e-e0107eb18bf0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:45.447799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a8c3b076-6874-40e2-ba1e-e0107eb18bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:45.525615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:45.528659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:45.587880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 957/1917] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:45.596670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3b076-6874-40e2-ba1e-e0107eb18bf0 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:45.598354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a8c3b076-6874-40e2-ba1e-e0107eb18bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:45.640605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:45.652855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff6a85-04bc-4db3-a013-e4043ec140fb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:45.659171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:45.659603 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.659957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.660325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] PATH_INFO: `/v3/users/0e8271f4d1da4e67b3718b42aec88b3d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.661712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8271f4d1da4e67b3718b42aec88b3d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:45.663930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:45.704532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:45.706091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3b076-6874-40e2-ba1e-e0107eb18bf0 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:45.713949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba36a-33ae-4ef9-be7b-f16d19543247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:45.725639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba36a-33ae-4ef9-be7b-f16d19543247 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.725639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba36a-33ae-4ef9-be7b-f16d19543247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.725639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba36a-33ae-4ef9-be7b-f16d19543247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.746740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8271f4d1da4e67b3718b42aec88b3d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.747408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8271f4d1da4e67b3718b42aec88b3d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.763840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8271f4d1da4e67b3718b42aec88b3d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.765150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba36a-33ae-4ef9-be7b-f16d19543247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:45.766946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba36a-33ae-4ef9-be7b-f16d19543247 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:45.773447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8271f4d1da4e67b3718b42aec88b3d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.774476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8271f4d1da4e67b3718b42aec88b3d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:45.788628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 958/1918] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:45.791639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 961/1919] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:45 2022] DELETE /identity/v3/users/0e8271f4d1da4e67b3718b42aec88b3d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:45.797069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b877-8ae9-4ee9-bf41-d787f7bef272 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.797366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b877-8ae9-4ee9-bf41-d787f7bef272 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.797646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b877-8ae9-4ee9-bf41-d787f7bef272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.820936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4148b877-8ae9-4ee9-bf41-d787f7bef272 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:45.823173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4148b877-8ae9-4ee9-bf41-d787f7bef272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:45.928351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 959/1920] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:45.938631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:45.940379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:46.070931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47c09f-2ba5-40a8-8769-202f0221d3dc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:46.076732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55619393-68da-43e6-93ff-4d4bab03bd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:46.077443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619393-68da-43e6-93ff-4d4bab03bd36 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:46.077726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619393-68da-43e6-93ff-4d4bab03bd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:46.078033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619393-68da-43e6-93ff-4d4bab03bd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:46.088823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55619393-68da-43e6-93ff-4d4bab03bd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:46.090317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55619393-68da-43e6-93ff-4d4bab03bd36 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:46.103940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 962/1921] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:46.179764 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b877-8ae9-4ee9-bf41-d787f7bef272 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:46.181342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4148b877-8ae9-4ee9-bf41-d787f7bef272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:46.195493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b877-8ae9-4ee9-bf41-d787f7bef272 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:46.201063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:46.202064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:46.202419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:46.202762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] PATH_INFO: `/v3/projects/977db99d4c714dfc9bd3193965c67b00` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:46.204282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] RBAC: Authorizing `identity:delete_project(project_id=977db99d4c714dfc9bd3193965c67b00)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:46.206367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:46.290113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977db99d4c714dfc9bd3193965c67b00', 'request_id': 'req-347139b7-8826-4d49-aa02-10bb3b5a035d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.296981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977db99d4c714dfc9bd3193965c67b00', 'request_id': 'req-347139b7-8826-4d49-aa02-10bb3b5a035d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.308315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977db99d4c714dfc9bd3193965c67b00', 'request_id': 'req-347139b7-8826-4d49-aa02-10bb3b5a035d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.322461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] The token cache is being invalidate because project 977db99d4c714dfc9bd3193965c67b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:46.322884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.323612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.325885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 960/1922] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:46 2022] DELETE /identity/v3/projects/977db99d4c714dfc9bd3193965c67b00 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:46.330875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55619393-68da-43e6-93ff-4d4bab03bd36 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:46.343181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55619393-68da-43e6-93ff-4d4bab03bd36 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:46.410240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:46.411145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:46.411504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:46.411857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] PATH_INFO: `/v3/users/14344651b1364f76a84dd2ec6f60aff3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:46.413171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14344651b1364f76a84dd2ec6f60aff3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:46.415282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:46.479125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14344651b1364f76a84dd2ec6f60aff3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.479843 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14344651b1364f76a84dd2ec6f60aff3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.481186 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:46.496879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14344651b1364f76a84dd2ec6f60aff3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.510704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14344651b1364f76a84dd2ec6f60aff3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.512145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14344651b1364f76a84dd2ec6f60aff3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.534507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 963/1923] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:46 2022] DELETE /identity/v3/users/14344651b1364f76a84dd2ec6f60aff3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:46.626695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:46.627950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:46.665598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347139b7-8826-4d49-aa02-10bb3b5a035d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:46.786718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:46.818509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:46.819169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:46.819453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:46.819726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] PATH_INFO: `/v3/projects/b31d605ba70a401994f79e5281709017` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:46.823690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31d605ba70a401994f79e5281709017)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:46.830159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:46.926058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31d605ba70a401994f79e5281709017', 'request_id': 'req-d402fcd1-1ae7-4d21-bc19-182e39df8591'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.943668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31d605ba70a401994f79e5281709017', 'request_id': 'req-d402fcd1-1ae7-4d21-bc19-182e39df8591'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.956513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31d605ba70a401994f79e5281709017', 'request_id': 'req-d402fcd1-1ae7-4d21-bc19-182e39df8591'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.986107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] The token cache is being invalidate because project b31d605ba70a401994f79e5281709017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:46.987052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.988008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:46.994342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 961/1924] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:46 2022] DELETE /identity/v3/projects/b31d605ba70a401994f79e5281709017 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:46.996279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:46.999556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:47.026281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3054e-f361-42eb-87ff-5e87e46a0a10 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:47.058610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:47.060202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:47.156272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:47.156922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:47.157205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:47.157486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] PATH_INFO: `/v3/users/87b4cc49e5fc49989b7cdba99c02146e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:47.158666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b4cc49e5fc49989b7cdba99c02146e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:47.160729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:47.181796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402fcd1-1ae7-4d21-bc19-182e39df8591 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:47.191851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:47.193737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:47.194052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:47.194443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] PATH_INFO: `/v3/projects/1571c1321d4045fdbaac2e95406660d6` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:47.196271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1571c1321d4045fdbaac2e95406660d6)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:47.199329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:47.254080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b4cc49e5fc49989b7cdba99c02146e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.254916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b4cc49e5fc49989b7cdba99c02146e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.263961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1571c1321d4045fdbaac2e95406660d6', 'request_id': 'req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.270864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b4cc49e5fc49989b7cdba99c02146e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.271530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1571c1321d4045fdbaac2e95406660d6', 'request_id': 'req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.281070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b4cc49e5fc49989b7cdba99c02146e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.281939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b4cc49e5fc49989b7cdba99c02146e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.284165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1571c1321d4045fdbaac2e95406660d6', 'request_id': 'req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.297258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 964/1925] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:46 2022] DELETE /identity/v3/users/87b4cc49e5fc49989b7cdba99c02146e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:47.298169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] The token cache is being invalidate because project 1571c1321d4045fdbaac2e95406660d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:47.298518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.299191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.300698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 962/1926] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:47 2022] DELETE /identity/v3/projects/1571c1321d4045fdbaac2e95406660d6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:47.304534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:47.305955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:47.376570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:47.402791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7d63b-0668-4f2e-81a5-48fd3efe7268 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:47.411217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:47.411930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:47.412470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:47.412807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] PATH_INFO: `/v3/users/c8ccc3f451e8422195bed8c103f109c7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:47.414057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ccc3f451e8422195bed8c103f109c7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:47.416609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:47.472469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ccc3f451e8422195bed8c103f109c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.473172 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ccc3f451e8422195bed8c103f109c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.489394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ccc3f451e8422195bed8c103f109c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.500687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ccc3f451e8422195bed8c103f109c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.501299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e9c6bb7-3632-4589-a0c8-44c559179585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ccc3f451e8422195bed8c103f109c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.515004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 965/1927] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:47 2022] DELETE /identity/v3/users/c8ccc3f451e8422195bed8c103f109c7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:47.631849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:47.634086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:47.647179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:47.710629 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be3b8f-a5f6-4778-8cd3-3a3dbaba140f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:47.777001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:47.777707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:47.778209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:47.778543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] PATH_INFO: `/v3/projects/21dbb3cb449840349c67a51f22825f06` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:47.780441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21dbb3cb449840349c67a51f22825f06)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:47.783182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:47.848464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21dbb3cb449840349c67a51f22825f06', 'request_id': 'req-9ec453f5-c391-46dd-8433-538a3f0174e6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.854643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21dbb3cb449840349c67a51f22825f06', 'request_id': 'req-9ec453f5-c391-46dd-8433-538a3f0174e6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.864324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21dbb3cb449840349c67a51f22825f06', 'request_id': 'req-9ec453f5-c391-46dd-8433-538a3f0174e6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.879794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] The token cache is being invalidate because project 21dbb3cb449840349c67a51f22825f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:47.880093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.881477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:47.883356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 963/1928] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:47 2022] DELETE /identity/v3/projects/21dbb3cb449840349c67a51f22825f06 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:47.888702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0484af-0b84-4197-abb4-19d47d22334f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:47.888907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0484af-0b84-4197-abb4-19d47d22334f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:47.889252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0484af-0b84-4197-abb4-19d47d22334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:47.916592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8f0484af-0b84-4197-abb4-19d47d22334f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:47.917849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f0484af-0b84-4197-abb4-19d47d22334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:47.986175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:47.987658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:48.021185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 966/1929] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:48.030981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c6593-3797-4f8b-b5db-71c2aa2d7725 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.031285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c6593-3797-4f8b-b5db-71c2aa2d7725 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.031561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c6593-3797-4f8b-b5db-71c2aa2d7725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.052397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:48.052815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-469c6593-3797-4f8b-b5db-71c2aa2d7725 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:48.054365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-469c6593-3797-4f8b-b5db-71c2aa2d7725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:48.065314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 967/1930] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:48.069197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c6593-3797-4f8b-b5db-71c2aa2d7725 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.076045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec453f5-c391-46dd-8433-538a3f0174e6 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.078872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c6593-3797-4f8b-b5db-71c2aa2d7725 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.081896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.083593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.083593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.083593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] PATH_INFO: `/v3/projects/e6ba9122010346a3afcff7a19ce501ac` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.086056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.086639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.086930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.087211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.087866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:48.088170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.089957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.090907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ba9122010346a3afcff7a19ce501ac)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.093974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.105952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 968/1931] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:48.112378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.128588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e37116-3062-4207-aabb-ffcb94979d22 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.135322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6de54b-4ca2-4646-964e-b01b049cde5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.135994 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de54b-4ca2-4646-964e-b01b049cde5c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.136282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de54b-4ca2-4646-964e-b01b049cde5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.136565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6de54b-4ca2-4646-964e-b01b049cde5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.137290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6de54b-4ca2-4646-964e-b01b049cde5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.140290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6de54b-4ca2-4646-964e-b01b049cde5c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.163865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ba9122010346a3afcff7a19ce501ac', 'request_id': 'req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:48.171796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ba9122010346a3afcff7a19ce501ac', 'request_id': 'req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:48.179676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 969/1932] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:48.184146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6de54b-4ca2-4646-964e-b01b049cde5c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.194617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ba9122010346a3afcff7a19ce501ac', 'request_id': 'req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:48.214263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] The token cache is being invalidate because project e6ba9122010346a3afcff7a19ce501ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:48.215414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:48.216264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1dd7bf04-99c6-484b-8944-aeaeaeb1f925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:48.219294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 964/1933] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:47 2022] DELETE /identity/v3/projects/e6ba9122010346a3afcff7a19ce501ac => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:48.225327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:48.226290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6e89-f588-4572-88a8-c6fcee75dfc4 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.226831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6e89-f588-4572-88a8-c6fcee75dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.227137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df6e89-f588-4572-88a8-c6fcee75dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.250376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c6df6e89-f588-4572-88a8-c6fcee75dfc4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:48.251600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c6df6e89-f588-4572-88a8-c6fcee75dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:48.296656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6de54b-4ca2-4646-964e-b01b049cde5c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.307318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.308748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.309245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.310394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.313184 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.315429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.355741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 970/1934] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:48.363601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.370088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:48.416729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ca75b-0c7d-4421-8c0a-91812675042c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.417034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 965/1935] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:48.418844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20440e8-ce59-4d85-b2f3-1a589d465b65 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.419591 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20440e8-ce59-4d85-b2f3-1a589d465b65 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.431589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20440e8-ce59-4d85-b2f3-1a589d465b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.436521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa3d76-f8bc-4c55-a14a-67a7b4787ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.437255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa3d76-f8bc-4c55-a14a-67a7b4787ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.437543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa3d76-f8bc-4c55-a14a-67a7b4787ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.437827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa3d76-f8bc-4c55-a14a-67a7b4787ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.439077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa3d76-f8bc-4c55-a14a-67a7b4787ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.443461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa3d76-f8bc-4c55-a14a-67a7b4787ac0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.462539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 971/1936] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:48.467510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa3d76-f8bc-4c55-a14a-67a7b4787ac0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.480973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e20440e8-ce59-4d85-b2f3-1a589d465b65 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:48.482235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e20440e8-ce59-4d85-b2f3-1a589d465b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:48.491015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa3d76-f8bc-4c55-a14a-67a7b4787ac0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.499199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 966/1937] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:48.503402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20440e8-ce59-4d85-b2f3-1a589d465b65 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.517784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028982e-de49-497f-bf05-84144f536836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.519358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20440e8-ce59-4d85-b2f3-1a589d465b65 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.520859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028982e-de49-497f-bf05-84144f536836 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.521151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028982e-de49-497f-bf05-84144f536836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.521435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028982e-de49-497f-bf05-84144f536836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.530692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.531427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.532811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028982e-de49-497f-bf05-84144f536836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.533057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.533355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.534054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:48.534366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.535989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.536444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028982e-de49-497f-bf05-84144f536836 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.553563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 967/1938] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:48.557942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.574369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 972/1939] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:48.575051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9739a45-22bb-4123-b172-e79ef0c901fb admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.579001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028982e-de49-497f-bf05-84144f536836 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.585493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb05d6-6478-4c6c-b6d9-c336e417b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.585919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb05d6-6478-4c6c-b6d9-c336e417b172 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.586551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb05d6-6478-4c6c-b6d9-c336e417b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.586662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb05d6-6478-4c6c-b6d9-c336e417b172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.587484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb05d6-6478-4c6c-b6d9-c336e417b172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.589875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb05d6-6478-4c6c-b6d9-c336e417b172 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.594967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028982e-de49-497f-bf05-84144f536836 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.607919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d71ba3-b29d-4ef3-a0c3-b40693075fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.608864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71ba3-b29d-4ef3-a0c3-b40693075fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.609160 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71ba3-b29d-4ef3-a0c3-b40693075fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.609445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71ba3-b29d-4ef3-a0c3-b40693075fc3 admin admin] PATH_INFO: `/v3/projects/8c4146cddb974a9099190e8fad3da0a6/users/62e77cd756944395b40a8bea7660c7a1/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.633534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d71ba3-b29d-4ef3-a0c3-b40693075fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4146cddb974a9099190e8fad3da0a6, user_id=62e77cd756944395b40a8bea7660c7a1, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.636765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d71ba3-b29d-4ef3-a0c3-b40693075fc3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.636889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 968/1940] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/projects => generated 391 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:48.642533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb05d6-6478-4c6c-b6d9-c336e417b172 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.658472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 973/1941] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:48 2022] PUT /identity/v3/projects/8c4146cddb974a9099190e8fad3da0a6/users/62e77cd756944395b40a8bea7660c7a1/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:48.668277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd4e5-c438-40c0-a02d-c219d955d498 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.668643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd4e5-c438-40c0-a02d-c219d955d498 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.669088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd4e5-c438-40c0-a02d-c219d955d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.723387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:48.729577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ea8fd4e5-c438-40c0-a02d-c219d955d498 None None] MFA Rules not processed for user `62e77cd756944395b40a8bea7660c7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:48.734912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ea8fd4e5-c438-40c0-a02d-c219d955d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:48.778003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb05d6-6478-4c6c-b6d9-c336e417b172 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.891872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 974/1942] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:48.913572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28047c3-5231-46a7-99fa-1243da08b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.914541 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28047c3-5231-46a7-99fa-1243da08b45a admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.915652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28047c3-5231-46a7-99fa-1243da08b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.920667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28047c3-5231-46a7-99fa-1243da08b45a admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.920667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28047c3-5231-46a7-99fa-1243da08b45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.923193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28047c3-5231-46a7-99fa-1243da08b45a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:48.956349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd4e5-c438-40c0-a02d-c219d955d498 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.957178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 969/1943] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/users => generated 296 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:48.958270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ea8fd4e5-c438-40c0-a02d-c219d955d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:48.961480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28047c3-5231-46a7-99fa-1243da08b45a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:48.977913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28047c3-5231-46a7-99fa-1243da08b45a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:48.985937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:48.986789 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.987270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.988005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:48.990175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:48.992075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.018081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 970/1944] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:49.020002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.022372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.039729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08023dbf-833d-464a-9c23-d46eb36ae6d8 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.050549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd4e5-c438-40c0-a02d-c219d955d498 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.050740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.051817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.052104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.052379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] PATH_INFO: `/v3/users/00b76c11ce244ecd96454f65cb9641fd` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.055097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b76c11ce244ecd96454f65cb9641fd)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.057118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.062730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8475b9-43e2-4957-bf35-0ce8a08bca82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.064865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8475b9-43e2-4957-bf35-0ce8a08bca82 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.065331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8475b9-43e2-4957-bf35-0ce8a08bca82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.066426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8475b9-43e2-4957-bf35-0ce8a08bca82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.112427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8475b9-43e2-4957-bf35-0ce8a08bca82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.113937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8475b9-43e2-4957-bf35-0ce8a08bca82 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.118273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b76c11ce244ecd96454f65cb9641fd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.119846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b76c11ce244ecd96454f65cb9641fd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.130034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:49.144451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b76c11ce244ecd96454f65cb9641fd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.145231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 975/1945] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:49.146625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8475b9-43e2-4957-bf35-0ce8a08bca82 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.163400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b76c11ce244ecd96454f65cb9641fd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.177615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8475b9-43e2-4957-bf35-0ce8a08bca82 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.177991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b76c11ce244ecd96454f65cb9641fd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.191844 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6f18a-6f9b-4ad5-b18f-b0348fe0948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.192542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6f18a-6f9b-4ad5-b18f-b0348fe0948b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.192821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6f18a-6f9b-4ad5-b18f-b0348fe0948b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.193332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6f18a-6f9b-4ad5-b18f-b0348fe0948b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.195135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6f18a-6f9b-4ad5-b18f-b0348fe0948b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.196607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 971/1946] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:49 2022] DELETE /identity/v3/users/00b76c11ce244ecd96454f65cb9641fd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:49.199800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.199905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6f18a-6f9b-4ad5-b18f-b0348fe0948b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.199983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.227282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 976/1947] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:49.232503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d5d8d-2acd-4925-9824-cc185ab9a012 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.232907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d5d8d-2acd-4925-9824-cc185ab9a012 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.233225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d5d8d-2acd-4925-9824-cc185ab9a012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.257437 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:49.275764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1c3d5d8d-2acd-4925-9824-cc185ab9a012 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:49.276908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c3d5d8d-2acd-4925-9824-cc185ab9a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.313319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26e1e4-485a-44e8-89ac-d98386d66704 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.319570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.320141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.320438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.320705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] PATH_INFO: `/v3/users/62e77cd756944395b40a8bea7660c7a1` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.322288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e77cd756944395b40a8bea7660c7a1)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.324577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.394744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e77cd756944395b40a8bea7660c7a1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.395440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e77cd756944395b40a8bea7660c7a1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.412147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e77cd756944395b40a8bea7660c7a1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.421259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 977/1948] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:49.424762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e77cd756944395b40a8bea7660c7a1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.425276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d5d8d-2acd-4925-9824-cc185ab9a012 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.425833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e77cd756944395b40a8bea7660c7a1'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:49.426835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c3d5d8d-2acd-4925-9824-cc185ab9a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.441690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d5d8d-2acd-4925-9824-cc185ab9a012 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.442404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 972/1949] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:49 2022] DELETE /identity/v3/users/62e77cd756944395b40a8bea7660c7a1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:49.443519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.446721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.515294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24a5ec-b2a3-40cc-a565-96cd98841972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.516212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a5ec-b2a3-40cc-a565-96cd98841972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.516721 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a5ec-b2a3-40cc-a565-96cd98841972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.517151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24a5ec-b2a3-40cc-a565-96cd98841972 admin admin] PATH_INFO: `/v3/projects/db0bbe9bfd1a4423ac7deddf2bf962af/users/3dc9d7364de641a5a57aefb36c20d191/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.540346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24a5ec-b2a3-40cc-a565-96cd98841972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0bbe9bfd1a4423ac7deddf2bf962af, user_id=3dc9d7364de641a5a57aefb36c20d191, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.544430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24a5ec-b2a3-40cc-a565-96cd98841972 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.546911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c05757-8bfa-4082-a6c0-5b638366695e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.554603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df497e-422c-4049-91f7-3354796db23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.555740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df497e-422c-4049-91f7-3354796db23c service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.556294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df497e-422c-4049-91f7-3354796db23c service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.556688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df497e-422c-4049-91f7-3354796db23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.572822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df497e-422c-4049-91f7-3354796db23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.573686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 978/1950] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:49 2022] PUT /identity/v3/projects/db0bbe9bfd1a4423ac7deddf2bf962af/users/3dc9d7364de641a5a57aefb36c20d191/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:49.574375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df497e-422c-4049-91f7-3354796db23c service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.575739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051d97-dcc5-4eb5-b6e3-db28716d635c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.576984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051d97-dcc5-4eb5-b6e3-db28716d635c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.577508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e051d97-dcc5-4eb5-b6e3-db28716d635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.590316 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 973/1951] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:49.592080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164cb9-a919-43ab-8b45-56afcbcf1844 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.592843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164cb9-a919-43ab-8b45-56afcbcf1844 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.593169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164cb9-a919-43ab-8b45-56afcbcf1844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.635369 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1e051d97-dcc5-4eb5-b6e3-db28716d635c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:49.638323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1e051d97-dcc5-4eb5-b6e3-db28716d635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.667007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-9d164cb9-a919-43ab-8b45-56afcbcf1844 None None] MFA Rules not processed for user `3dc9d7364de641a5a57aefb36c20d191`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:49.670901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9d164cb9-a919-43ab-8b45-56afcbcf1844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.769745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:49.788219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 979/1952] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:49.806325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051d97-dcc5-4eb5-b6e3-db28716d635c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.822531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 974/1953] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:49.822919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:49.823939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d164cb9-a919-43ab-8b45-56afcbcf1844 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.837763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d164cb9-a919-43ab-8b45-56afcbcf1844 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.843424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242ee4-c29f-4550-ba8f-46870d6ba446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.844030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242ee4-c29f-4550-ba8f-46870d6ba446 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.844923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242ee4-c29f-4550-ba8f-46870d6ba446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.844923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242ee4-c29f-4550-ba8f-46870d6ba446 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.845385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c242ee4-c29f-4550-ba8f-46870d6ba446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.861980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c242ee4-c29f-4550-ba8f-46870d6ba446 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.892103 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e051d97-dcc5-4eb5-b6e3-db28716d635c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.897496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1f8c-566f-41a3-ac69-50c0993f8380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.898517 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1f8c-566f-41a3-ac69-50c0993f8380 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.899010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1f8c-566f-41a3-ac69-50c0993f8380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.899501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d1f8c-566f-41a3-ac69-50c0993f8380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.905251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 975/1954] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:49 2022] POST /identity/v3/projects => generated 393 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:49.906372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242ee4-c29f-4550-ba8f-46870d6ba446 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.911357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1f8c-566f-41a3-ac69-50c0993f8380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.913203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d1f8c-566f-41a3-ac69-50c0993f8380 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.929058 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 980/1955] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:49.989087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242ee4-c29f-4550-ba8f-46870d6ba446 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.994809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.995516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.995806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.996079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.997105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:50.000337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:50.034670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 976/1956] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:49 2022] POST /identity/v3/users => generated 303 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:50.036410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1f8c-566f-41a3-ac69-50c0993f8380 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:50.058898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d1f8c-566f-41a3-ac69-50c0993f8380 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:50.070974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19fb34-0806-4267-90ea-664d65710961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:50.071602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19fb34-0806-4267-90ea-664d65710961 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.071885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19fb34-0806-4267-90ea-664d65710961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.072158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19fb34-0806-4267-90ea-664d65710961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.072879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19fb34-0806-4267-90ea-664d65710961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:50.077590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19fb34-0806-4267-90ea-664d65710961 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:50.078874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:50.082110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:50.089773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 981/1957] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:50.095918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19fb34-0806-4267-90ea-664d65710961 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:50.110854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cf8c4-62db-4afb-967c-57e105f25bf9 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:50.120638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:50.121485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.122009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.122557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] PATH_INFO: `/v3/projects/618a74d808e643e59d02c105e59c5035` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.124853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618a74d808e643e59d02c105e59c5035)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:50.130667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:50.147459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19fb34-0806-4267-90ea-664d65710961 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:50.160642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120465a1-5078-4e01-a0bf-2921cb7ab653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:50.161666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120465a1-5078-4e01-a0bf-2921cb7ab653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.162031 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120465a1-5078-4e01-a0bf-2921cb7ab653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.164376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120465a1-5078-4e01-a0bf-2921cb7ab653 admin admin] PATH_INFO: `/v3/projects/36860c9cdef64c91a23c7460b52012bd/users/6dba335cb1684289bc9ae982355f7e82/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.185074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120465a1-5078-4e01-a0bf-2921cb7ab653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36860c9cdef64c91a23c7460b52012bd, user_id=6dba335cb1684289bc9ae982355f7e82, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:50.188669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120465a1-5078-4e01-a0bf-2921cb7ab653 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:50.211091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 982/1958] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:50 2022] PUT /identity/v3/projects/36860c9cdef64c91a23c7460b52012bd/users/6dba335cb1684289bc9ae982355f7e82/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:50.212291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120465a1-5078-4e01-a0bf-2921cb7ab653 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:50.235295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618a74d808e643e59d02c105e59c5035', 'request_id': 'req-c98be133-dd85-47fa-8395-b26d51e23086'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.251143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618a74d808e643e59d02c105e59c5035', 'request_id': 'req-c98be133-dd85-47fa-8395-b26d51e23086'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.271828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618a74d808e643e59d02c105e59c5035', 'request_id': 'req-c98be133-dd85-47fa-8395-b26d51e23086'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.297719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] The token cache is being invalidate because project 618a74d808e643e59d02c105e59c5035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:50.298305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.299928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.305118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 977/1959] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:50 2022] DELETE /identity/v3/projects/618a74d808e643e59d02c105e59c5035 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:50.306759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:50.311692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:50.315166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120465a1-5078-4e01-a0bf-2921cb7ab653 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:50.411229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:50.412555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.412930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.413156 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.414143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:50.417681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:50.424415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:50.442350 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 983/1960] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:50.454930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:50.471880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:50.481425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be133-dd85-47fa-8395-b26d51e23086 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:50.486827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:50.487481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.487829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.488108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] PATH_INFO: `/v3/users/dbd1e278fc0c4c44aca92bc3dceec877` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.489584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd1e278fc0c4c44aca92bc3dceec877)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:50.492042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:50.504227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2700db-2a2d-439e-8b7e-355245eca221 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:50.509872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:50.510676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.510966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.511546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] PATH_INFO: `/v3/projects/8c4146cddb974a9099190e8fad3da0a6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.513087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4146cddb974a9099190e8fad3da0a6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:50.516770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:50.549277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:50.575242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd1e278fc0c4c44aca92bc3dceec877'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.576875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd1e278fc0c4c44aca92bc3dceec877'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.601374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4146cddb974a9099190e8fad3da0a6', 'request_id': 'req-12573df6-7982-4ed3-b1c7-664e7999da27'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.605942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd1e278fc0c4c44aca92bc3dceec877'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.616194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4146cddb974a9099190e8fad3da0a6', 'request_id': 'req-12573df6-7982-4ed3-b1c7-664e7999da27'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.619816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd1e278fc0c4c44aca92bc3dceec877'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.621296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd1e278fc0c4c44aca92bc3dceec877'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.624966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4146cddb974a9099190e8fad3da0a6', 'request_id': 'req-12573df6-7982-4ed3-b1c7-664e7999da27'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.642207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] The token cache is being invalidate because project 8c4146cddb974a9099190e8fad3da0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:50.642495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.643197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12573df6-7982-4ed3-b1c7-664e7999da27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:50.646307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 978/1961] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:50 2022] DELETE /identity/v3/users/dbd1e278fc0c4c44aca92bc3dceec877 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:50.646583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 984/1962] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:50 2022] DELETE /identity/v3/projects/8c4146cddb974a9099190e8fad3da0a6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:50.646659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:50.646824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:50.650912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abce6-0fa5-4bd4-b34f-aeb8513a263a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.651227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abce6-0fa5-4bd4-b34f-aeb8513a263a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.652470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abce6-0fa5-4bd4-b34f-aeb8513a263a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.697143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1e1abce6-0fa5-4bd4-b34f-aeb8513a263a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:50.711328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1e1abce6-0fa5-4bd4-b34f-aeb8513a263a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:50.833952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dadb0-6c21-47f6-8c92-fe142623d90e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:50.835044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 985/1963] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:50.852502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8bd3-7c9e-46c2-973e-b30930a14b92 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.852502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8bd3-7c9e-46c2-973e-b30930a14b92 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.852502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8bd3-7c9e-46c2-973e-b30930a14b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.864211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27307168-a981-49ee-9112-7d39664bfdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:50.865832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27307168-a981-49ee-9112-7d39664bfdd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.865832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27307168-a981-49ee-9112-7d39664bfdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.865832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27307168-a981-49ee-9112-7d39664bfdd0 admin admin] PATH_INFO: `/v3/projects/36860c9cdef64c91a23c7460b52012bd/users/6dba335cb1684289bc9ae982355f7e82/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.868039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27307168-a981-49ee-9112-7d39664bfdd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36860c9cdef64c91a23c7460b52012bd, user_id=6dba335cb1684289bc9ae982355f7e82, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:50.870777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27307168-a981-49ee-9112-7d39664bfdd0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:50.894066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 979/1964] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:50 2022] PUT /identity/v3/projects/36860c9cdef64c91a23c7460b52012bd/users/6dba335cb1684289bc9ae982355f7e82/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:50.894332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-319d8bd3-7c9e-46c2-973e-b30930a14b92 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:50.895483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed24e-3021-4c77-818e-cadbb8ab03cc None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:50.895880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed24e-3021-4c77-818e-cadbb8ab03cc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:50.896232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed24e-3021-4c77-818e-cadbb8ab03cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:50.897491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-319d8bd3-7c9e-46c2-973e-b30930a14b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:50.968417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-9d2ed24e-3021-4c77-818e-cadbb8ab03cc None None] MFA Rules not processed for user `6dba335cb1684289bc9ae982355f7e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:50.969980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9d2ed24e-3021-4c77-818e-cadbb8ab03cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:51.037827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:51.085456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 986/1965] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:51.087659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8bd3-7c9e-46c2-973e-b30930a14b92 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.112378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8bd3-7c9e-46c2-973e-b30930a14b92 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.121569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 980/1966] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:51.132501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.133697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.133697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.133697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.134353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:51.134662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.135340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ed24e-3021-4c77-818e-cadbb8ab03cc None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.136799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9d2ed24e-3021-4c77-818e-cadbb8ab03cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:51.140090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.160523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 987/1967] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:51.165625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.182370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99517c4-77be-4c17-b9b6-ffa9ee41c9ee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.203079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.204287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.204287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.204793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.205661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.209374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.257099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ed24e-3021-4c77-818e-cadbb8ab03cc None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.261120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0e913-5f49-4ba5-9152-1ea6d17acea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.261755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e913-5f49-4ba5-9152-1ea6d17acea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.262074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e913-5f49-4ba5-9152-1ea6d17acea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.262517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0e913-5f49-4ba5-9152-1ea6d17acea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.271897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 988/1968] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:51 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:51.273396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.275729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:51.277231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0e913-5f49-4ba5-9152-1ea6d17acea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.279968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0e913-5f49-4ba5-9152-1ea6d17acea4 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.293981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 981/1969] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:51.295233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0e913-5f49-4ba5-9152-1ea6d17acea4 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.301402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:51.309272 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0e913-5f49-4ba5-9152-1ea6d17acea4 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.396959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef67b22-ad27-4c69-9d0b-556c156392bc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.399336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779de2a-8f8e-4c07-b525-4ddd4509c579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.401110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779de2a-8f8e-4c07-b525-4ddd4509c579 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.401403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779de2a-8f8e-4c07-b525-4ddd4509c579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.402215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779de2a-8f8e-4c07-b525-4ddd4509c579 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.403905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779de2a-8f8e-4c07-b525-4ddd4509c579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.406740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779de2a-8f8e-4c07-b525-4ddd4509c579 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.409614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.410423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.410814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.411189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] PATH_INFO: `/v3/projects/5e5fdcfd169648c1be436940b99aa56e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.413535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5fdcfd169648c1be436940b99aa56e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.415557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.447722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 982/1970] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:51 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:51.449495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779de2a-8f8e-4c07-b525-4ddd4509c579 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.531456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5fdcfd169648c1be436940b99aa56e', 'request_id': 'req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:51.552926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5fdcfd169648c1be436940b99aa56e', 'request_id': 'req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:51.561075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5fdcfd169648c1be436940b99aa56e', 'request_id': 'req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:51.579327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] The token cache is being invalidate because project 5e5fdcfd169648c1be436940b99aa56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:51.579622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:51.582670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:51.586562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 989/1971] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:51 2022] DELETE /identity/v3/projects/5e5fdcfd169648c1be436940b99aa56e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:51.588707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.590435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779de2a-8f8e-4c07-b525-4ddd4509c579 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.593075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:51.621510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:51.682314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.682938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.683206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.683479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.686004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:51.758816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03205d4e-4cf9-4f25-a9d8-f9de9bc0882d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.764825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f39cc7-3569-4d26-855b-52801635ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.765823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39cc7-3569-4d26-855b-52801635ae9f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.766640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39cc7-3569-4d26-855b-52801635ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.767096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39cc7-3569-4d26-855b-52801635ae9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.768169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f39cc7-3569-4d26-855b-52801635ae9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.769995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f39cc7-3569-4d26-855b-52801635ae9f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.788983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 990/1972] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:51.790568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7b043-d115-4726-93b5-81e68c92ff14 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.790794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7b043-d115-4726-93b5-81e68c92ff14 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.791077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7b043-d115-4726-93b5-81e68c92ff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.803733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.805302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.828207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-16d7b043-d115-4726-93b5-81e68c92ff14 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:51.829782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-16d7b043-d115-4726-93b5-81e68c92ff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:51.838175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 983/1973] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:51.840683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.842199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 991/1974] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:51.848124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565808-bbfd-46c6-a150-efe4fc414d64 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.848487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565808-bbfd-46c6-a150-efe4fc414d64 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.848764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565808-bbfd-46c6-a150-efe4fc414d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.874205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bea8-8c0e-4862-b0c4-0a3d1976ab83 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.882657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1e8f-83f9-402f-809e-5eeaece68034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.883424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1e8f-83f9-402f-809e-5eeaece68034 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.883794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1e8f-83f9-402f-809e-5eeaece68034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.884356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1e8f-83f9-402f-809e-5eeaece68034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.890059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1e8f-83f9-402f-809e-5eeaece68034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.894415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1e8f-83f9-402f-809e-5eeaece68034 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.897987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-83565808-bbfd-46c6-a150-efe4fc414d64 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:51.902858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83565808-bbfd-46c6-a150-efe4fc414d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:51.934221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 984/1975] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:51.934440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 992/1976] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:51.945528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565808-bbfd-46c6-a150-efe4fc414d64 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.947537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1e8f-83f9-402f-809e-5eeaece68034 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.973297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1e8f-83f9-402f-809e-5eeaece68034 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.978807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.979532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.980029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.980405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.981299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:51.981708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.985782 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.989349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565808-bbfd-46c6-a150-efe4fc414d64 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.006468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 985/1977] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:52.006671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012029d4-1b27-4337-97e6-a7d689d3de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.006671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012029d4-1b27-4337-97e6-a7d689d3de7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.006671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012029d4-1b27-4337-97e6-a7d689d3de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.006671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012029d4-1b27-4337-97e6-a7d689d3de7c admin admin] PATH_INFO: `/v3/projects/eb1523bb9d8f428db870aa79fb9f1708/users/0ac5162dddc04796ab9ac29b2030c6e3/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.008064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.024746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d3f05-af8f-42f2-b1ef-7ea78e1c3798 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.033115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb9f54-0482-4836-a03c-b8bb7b98c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.035568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9f54-0482-4836-a03c-b8bb7b98c0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.035915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9f54-0482-4836-a03c-b8bb7b98c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.036403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9f54-0482-4836-a03c-b8bb7b98c0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.037177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb9f54-0482-4836-a03c-b8bb7b98c0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.039495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb9f54-0482-4836-a03c-b8bb7b98c0b5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.050116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012029d4-1b27-4337-97e6-a7d689d3de7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1523bb9d8f428db870aa79fb9f1708, user_id=0ac5162dddc04796ab9ac29b2030c6e3, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.058827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012029d4-1b27-4337-97e6-a7d689d3de7c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.081699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:52.091560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 993/1978] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:51 2022] PUT /identity/v3/projects/eb1523bb9d8f428db870aa79fb9f1708/users/0ac5162dddc04796ab9ac29b2030c6e3/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:52.104105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc8c6-1cba-4998-8904-19915dad7eb0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.108175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc8c6-1cba-4998-8904-19915dad7eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.108534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cc8c6-1cba-4998-8904-19915dad7eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.125173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 986/1979] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:52 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:52.128891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb9f54-0482-4836-a03c-b8bb7b98c0b5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.190302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f15cc8c6-1cba-4998-8904-19915dad7eb0 None None] MFA Rules not processed for user `0ac5162dddc04796ab9ac29b2030c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:52.191550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f15cc8c6-1cba-4998-8904-19915dad7eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:52.272777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb9f54-0482-4836-a03c-b8bb7b98c0b5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.280737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6343ae-4888-4228-95d3-953ebd13f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.281376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6343ae-4888-4228-95d3-953ebd13f6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.281704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6343ae-4888-4228-95d3-953ebd13f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.282040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6343ae-4888-4228-95d3-953ebd13f6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.282792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6343ae-4888-4228-95d3-953ebd13f6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.284821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6343ae-4888-4228-95d3-953ebd13f6f5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.325953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 987/1980] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:52 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:52.329694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6343ae-4888-4228-95d3-953ebd13f6f5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.352832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 994/1981] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:52.362432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6343ae-4888-4228-95d3-953ebd13f6f5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.380309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14ea8d-1348-462b-8f3d-93fbc704bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.380945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ea8d-1348-462b-8f3d-93fbc704bfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.381656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ea8d-1348-462b-8f3d-93fbc704bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.381656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ea8d-1348-462b-8f3d-93fbc704bfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.382219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14ea8d-1348-462b-8f3d-93fbc704bfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.383911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14ea8d-1348-462b-8f3d-93fbc704bfc3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.402044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cc8c6-1cba-4998-8904-19915dad7eb0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.403731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f15cc8c6-1cba-4998-8904-19915dad7eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:52.424441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 988/1982] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:52.428771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14ea8d-1348-462b-8f3d-93fbc704bfc3 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.473239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14ea8d-1348-462b-8f3d-93fbc704bfc3 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.486426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a45fc-ac61-4d2f-b28f-7ea0319a256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.487168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a45fc-ac61-4d2f-b28f-7ea0319a256b admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.487469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a45fc-ac61-4d2f-b28f-7ea0319a256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.487787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a45fc-ac61-4d2f-b28f-7ea0319a256b admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.488411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a45fc-ac61-4d2f-b28f-7ea0319a256b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.498851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a45fc-ac61-4d2f-b28f-7ea0319a256b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.503882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:52.525707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 989/1983] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:40:52.527718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a45fc-ac61-4d2f-b28f-7ea0319a256b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.539551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a45fc-ac61-4d2f-b28f-7ea0319a256b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.545699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aee7d2-e1be-4ef2-baa1-2e0517be04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.546896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aee7d2-e1be-4ef2-baa1-2e0517be04aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.547252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aee7d2-e1be-4ef2-baa1-2e0517be04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.547627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aee7d2-e1be-4ef2-baa1-2e0517be04aa admin admin] PATH_INFO: `/v3/projects/1aeafa9cbfe04311b9258a88518252ae/users/642da1eb361f451892caf47abb07c612/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.569564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aee7d2-e1be-4ef2-baa1-2e0517be04aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aeafa9cbfe04311b9258a88518252ae, user_id=642da1eb361f451892caf47abb07c612, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.572833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aee7d2-e1be-4ef2-baa1-2e0517be04aa admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.597889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 990/1984] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:52 2022] PUT /identity/v3/projects/1aeafa9cbfe04311b9258a88518252ae/users/642da1eb361f451892caf47abb07c612/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:52.606555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc776-279f-4746-9179-8a586195e5dc None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.607082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc776-279f-4746-9179-8a586195e5dc None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.608510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc776-279f-4746-9179-8a586195e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.672137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-fe7cc776-279f-4746-9179-8a586195e5dc None None] MFA Rules not processed for user `642da1eb361f451892caf47abb07c612`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:52.676744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fe7cc776-279f-4746-9179-8a586195e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:52.677522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cc8c6-1cba-4998-8904-19915dad7eb0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.801861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696aa74-13ac-452a-800e-a2827bbc4161 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c16885de9e4e82bcbede361e548ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.803596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696aa74-13ac-452a-800e-a2827bbc4161 service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.803887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696aa74-13ac-452a-800e-a2827bbc4161 service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.804163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696aa74-13ac-452a-800e-a2827bbc4161 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.822575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 991/1985] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:52.823509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc776-279f-4746-9179-8a586195e5dc None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.824803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fe7cc776-279f-4746-9179-8a586195e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:52.893878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:52.900756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc776-279f-4746-9179-8a586195e5dc None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.906955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.907863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.908287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.908709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] PATH_INFO: `/v3/users/5ed3a1a1fc964f3fa8004b86abff9ed5` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.910051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed3a1a1fc964f3fa8004b86abff9ed5)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.912883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.916966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696aa74-13ac-452a-800e-a2827bbc4161 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.918806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696aa74-13ac-452a-800e-a2827bbc4161 service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.932566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 995/1986] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:52.933580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696aa74-13ac-452a-800e-a2827bbc4161 service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.947115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696aa74-13ac-452a-800e-a2827bbc4161 service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.952625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.953593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.954017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.954522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.955275 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.958128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.989114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed3a1a1fc964f3fa8004b86abff9ed5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:52.990314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed3a1a1fc964f3fa8004b86abff9ed5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:53.008264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed3a1a1fc964f3fa8004b86abff9ed5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:53.013795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:53.022670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed3a1a1fc964f3fa8004b86abff9ed5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:53.025058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-239a5430-a7eb-4d7a-8c9b-508d84aeec7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed3a1a1fc964f3fa8004b86abff9ed5'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:53.058499 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 996/1987] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:52 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:53.060109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 992/1988] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:52 2022] DELETE /identity/v3/users/5ed3a1a1fc964f3fa8004b86abff9ed5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:53.064041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.066221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:53.067418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848a36-9f0d-4629-8cfa-1075f3465efb None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.067715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848a36-9f0d-4629-8cfa-1075f3465efb None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.068034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c848a36-9f0d-4629-8cfa-1075f3465efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.101083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3c848a36-9f0d-4629-8cfa-1075f3465efb None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:53.102417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3c848a36-9f0d-4629-8cfa-1075f3465efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:53.185014 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393770b3-f66f-40ce-8470-d084e7983613 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:53.261931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 993/1989] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:53.275058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848a36-9f0d-4629-8cfa-1075f3465efb None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.280418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3c848a36-9f0d-4629-8cfa-1075f3465efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:53.283326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7978-a752-4284-848c-c3ad3fc87f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:53.284099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7978-a752-4284-848c-c3ad3fc87f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.284391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7978-a752-4284-848c-c3ad3fc87f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.284662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7978-a752-4284-848c-c3ad3fc87f72 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.285296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7978-a752-4284-848c-c3ad3fc87f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:53.287685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7978-a752-4284-848c-c3ad3fc87f72 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:53.327154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 997/1990] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:53 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:53.329877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7978-a752-4284-848c-c3ad3fc87f72 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.345502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7978-a752-4284-848c-c3ad3fc87f72 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:53.354563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233adf49-13b2-4fe6-b008-960e4a566930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:53.355278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233adf49-13b2-4fe6-b008-960e4a566930 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.355455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233adf49-13b2-4fe6-b008-960e4a566930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.355734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233adf49-13b2-4fe6-b008-960e4a566930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.356414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233adf49-13b2-4fe6-b008-960e4a566930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:53.358670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233adf49-13b2-4fe6-b008-960e4a566930 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:53.368787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c848a36-9f0d-4629-8cfa-1075f3465efb None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:53.370020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 998/1991] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:53.372488 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc016-f332-4c74-9f4b-1bae8db67014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:53.374093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc016-f332-4c74-9f4b-1bae8db67014 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.374960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc016-f332-4c74-9f4b-1bae8db67014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.375094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233adf49-13b2-4fe6-b008-960e4a566930 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.375179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efc016-f332-4c74-9f4b-1bae8db67014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.384866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233adf49-13b2-4fe6-b008-960e4a566930 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:53.387318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efc016-f332-4c74-9f4b-1bae8db67014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:53.389300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efc016-f332-4c74-9f4b-1bae8db67014 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:53.390426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9aef4-e231-46f4-8d81-6682ea42471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:53.391189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9aef4-e231-46f4-8d81-6682ea42471f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.391651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9aef4-e231-46f4-8d81-6682ea42471f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.391933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9aef4-e231-46f4-8d81-6682ea42471f admin admin] PATH_INFO: `/v3/projects/035e3f371fda4347955712cd1a68b209/users/8782f9b5d74c4893bba4190f4cbdbb5e/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.405412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 994/1992] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:53.411066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9aef4-e231-46f4-8d81-6682ea42471f admin admin] RBAC: Authorizing `identity:create_grant(project_id=035e3f371fda4347955712cd1a68b209, user_id=8782f9b5d74c4893bba4190f4cbdbb5e, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:53.414099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9aef4-e231-46f4-8d81-6682ea42471f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:53.432471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 999/1993] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:53 2022] PUT /identity/v3/projects/035e3f371fda4347955712cd1a68b209/users/8782f9b5d74c4893bba4190f4cbdbb5e/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:53.438009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc016-f332-4c74-9f4b-1bae8db67014 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.450384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efc016-f332-4c74-9f4b-1bae8db67014 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:53.524998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd86b1-d758-4649-8b82-6c29bca4f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:53.525811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd86b1-d758-4649-8b82-6c29bca4f029 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.526157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd86b1-d758-4649-8b82-6c29bca4f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.526447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd86b1-d758-4649-8b82-6c29bca4f029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.527453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd86b1-d758-4649-8b82-6c29bca4f029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:53.529856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd86b1-d758-4649-8b82-6c29bca4f029 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:53.550045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 995/1994] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:53.551246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9aef4-e231-46f4-8d81-6682ea42471f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.564170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9aef4-e231-46f4-8d81-6682ea42471f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:53.585576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:53.587260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.587544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.587978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] PATH_INFO: `/v3/projects/035e3f371fda4347955712cd1a68b209/users/8782f9b5d74c4893bba4190f4cbdbb5e/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.595497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035e3f371fda4347955712cd1a68b209, user_id=8782f9b5d74c4893bba4190f4cbdbb5e, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:53.598425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:53.615631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1000/1995] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:53 2022] PUT /identity/v3/projects/035e3f371fda4347955712cd1a68b209/users/8782f9b5d74c4893bba4190f4cbdbb5e/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:53.628718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b369c2-3d43-41de-a509-dfe724017ec5 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.629320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b369c2-3d43-41de-a509-dfe724017ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.630041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b369c2-3d43-41de-a509-dfe724017ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.682188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-31b369c2-3d43-41de-a509-dfe724017ec5 None None] MFA Rules not processed for user `8782f9b5d74c4893bba4190f4cbdbb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:53.684187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-31b369c2-3d43-41de-a509-dfe724017ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:53.699346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:53.808111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 996/1996] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:53.823636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.826042 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:53.844461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:53.942640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df237ad-90a3-461e-834d-f6b4c33250d4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:53.949196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5c1d8-cccd-4066-96a9-c1a89e7d249f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:53.949727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c1d8-cccd-4066-96a9-c1a89e7d249f service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.950103 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c1d8-cccd-4066-96a9-c1a89e7d249f service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.950389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c1d8-cccd-4066-96a9-c1a89e7d249f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.959024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b369c2-3d43-41de-a509-dfe724017ec5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.961568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-31b369c2-3d43-41de-a509-dfe724017ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:53.985498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5c1d8-cccd-4066-96a9-c1a89e7d249f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:53.989239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5c1d8-cccd-4066-96a9-c1a89e7d249f service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:54.010077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1001/1997] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:54.123629 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b369c2-3d43-41de-a509-dfe724017ec5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:54.163010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5c1d8-cccd-4066-96a9-c1a89e7d249f service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:54.174641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:54.175311 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:54.175598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:54.175923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] PATH_INFO: `/v3/projects/cef27d68d89d4cc286628b52d6bf57ac` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:54.178189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef27d68d89d4cc286628b52d6bf57ac)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:54.181175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:54.186342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5c1d8-cccd-4066-96a9-c1a89e7d249f service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:54.194442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:54.195051 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:54.195426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:54.195823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:54.198437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:54.289196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef27d68d89d4cc286628b52d6bf57ac', 'request_id': 'req-5156760f-b1fd-4fe3-b121-842ae20eea69'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.294044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:54.297759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:54.307112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef27d68d89d4cc286628b52d6bf57ac', 'request_id': 'req-5156760f-b1fd-4fe3-b121-842ae20eea69'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.308469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1002/1998] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:54.322855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef27d68d89d4cc286628b52d6bf57ac', 'request_id': 'req-5156760f-b1fd-4fe3-b121-842ae20eea69'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.347960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] The token cache is being invalidate because project cef27d68d89d4cc286628b52d6bf57ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:54.348387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.349142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.362780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 997/1999] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:53 2022] DELETE /identity/v3/projects/cef27d68d89d4cc286628b52d6bf57ac => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:54.364115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:54.378325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc4f5a-da7f-4d55-abe5-3de79666b98b service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:54.459508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:54.460309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:54.460601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:54.460882 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] PATH_INFO: `/v3/users/334864ca5ebf447887cccb52059e7112` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:54.462069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=334864ca5ebf447887cccb52059e7112)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:54.464010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:54.550980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334864ca5ebf447887cccb52059e7112'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.551911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334864ca5ebf447887cccb52059e7112'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.554202 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:54.570030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334864ca5ebf447887cccb52059e7112'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.580606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334864ca5ebf447887cccb52059e7112'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.581363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-265492be-a940-4afc-97f6-9d30644177e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334864ca5ebf447887cccb52059e7112'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:54.599770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1003/2000] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:54 2022] DELETE /identity/v3/users/334864ca5ebf447887cccb52059e7112 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:54.946775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:54.948598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:54.968143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156760f-b1fd-4fe3-b121-842ae20eea69 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.012670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:55.054133 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.055164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.055589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.056121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] PATH_INFO: `/v3/projects/8f28940374c74de2a9a4b12bcb591017` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.057706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f28940374c74de2a9a4b12bcb591017)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.060861 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.111691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f28940374c74de2a9a4b12bcb591017', 'request_id': 'req-96698019-ea44-47c8-9c1a-c964533324c3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.117903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f28940374c74de2a9a4b12bcb591017', 'request_id': 'req-96698019-ea44-47c8-9c1a-c964533324c3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.127258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f28940374c74de2a9a4b12bcb591017', 'request_id': 'req-96698019-ea44-47c8-9c1a-c964533324c3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.143059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] The token cache is being invalidate because project 8f28940374c74de2a9a4b12bcb591017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:55.143600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.144261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-96698019-ea44-47c8-9c1a-c964533324c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.145796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 998/2001] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:54 2022] DELETE /identity/v3/projects/8f28940374c74de2a9a4b12bcb591017 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:55.151576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db937-26b3-4544-85b8-f503f4566b72 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.151870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db937-26b3-4544-85b8-f503f4566b72 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.152144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db937-26b3-4544-85b8-f503f4566b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.178046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c43db937-26b3-4544-85b8-f503f4566b72 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:55.179286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c43db937-26b3-4544-85b8-f503f4566b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:55.258477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1004/2002] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:55.267255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fffbb6-6aa3-4c1c-89d6-6fd3d10ff3f7 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.267827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fffbb6-6aa3-4c1c-89d6-6fd3d10ff3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.268318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fffbb6-6aa3-4c1c-89d6-6fd3d10ff3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.295507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e0fffbb6-6aa3-4c1c-89d6-6fd3d10ff3f7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:55.297186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e0fffbb6-6aa3-4c1c-89d6-6fd3d10ff3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:55.307634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 999/2003] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:55.310616 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db937-26b3-4544-85b8-f503f4566b72 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.321326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db937-26b3-4544-85b8-f503f4566b72 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.328147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.328983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.329446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.330066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.334276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:55.334276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.334276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.350915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1005/2004] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:55.355863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fffbb6-6aa3-4c1c-89d6-6fd3d10ff3f7 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.367115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fffbb6-6aa3-4c1c-89d6-6fd3d10ff3f7 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.373825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873098-e752-47bc-970f-d8828f92795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.374671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873098-e752-47bc-970f-d8828f92795f admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.375051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873098-e752-47bc-970f-d8828f92795f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.375427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873098-e752-47bc-970f-d8828f92795f admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.376153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873098-e752-47bc-970f-d8828f92795f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.378221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873098-e752-47bc-970f-d8828f92795f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.410291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1000/2005] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:55 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:55.413148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.423615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382524b-a603-46d0-8575-5beab587762e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.486831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a88f34-3628-41da-a550-0b92fe427b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.487436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a88f34-3628-41da-a550-0b92fe427b38 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.487787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a88f34-3628-41da-a550-0b92fe427b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.488192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a88f34-3628-41da-a550-0b92fe427b38 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.488813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a88f34-3628-41da-a550-0b92fe427b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.491180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a88f34-3628-41da-a550-0b92fe427b38 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.515816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1006/2006] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:55 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:55.519959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873098-e752-47bc-970f-d8828f92795f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.531139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873098-e752-47bc-970f-d8828f92795f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.536447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca3ae-97d2-4d52-af3d-6387c7ce3eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.537057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca3ae-97d2-4d52-af3d-6387c7ce3eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.537339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca3ae-97d2-4d52-af3d-6387c7ce3eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.537633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca3ae-97d2-4d52-af3d-6387c7ce3eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.538301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca3ae-97d2-4d52-af3d-6387c7ce3eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.539926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca3ae-97d2-4d52-af3d-6387c7ce3eb1 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.549919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1001/2007] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:55.554354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a88f34-3628-41da-a550-0b92fe427b38 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.564555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a88f34-3628-41da-a550-0b92fe427b38 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.569553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac54db-6c37-4651-8f1d-0fa96faa29c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.570196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac54db-6c37-4651-8f1d-0fa96faa29c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.570479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac54db-6c37-4651-8f1d-0fa96faa29c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.570756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac54db-6c37-4651-8f1d-0fa96faa29c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.571408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac54db-6c37-4651-8f1d-0fa96faa29c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.573048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac54db-6c37-4651-8f1d-0fa96faa29c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.586284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1007/2008] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:55.590584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca3ae-97d2-4d52-af3d-6387c7ce3eb1 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.601746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca3ae-97d2-4d52-af3d-6387c7ce3eb1 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.606370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.607045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.607435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.607716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] PATH_INFO: `/v3/projects/497486265b474f0db9cdb1f253398350/users/e574502912b24da3822a937b9a1a8623/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.622452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] RBAC: Authorizing `identity:create_grant(project_id=497486265b474f0db9cdb1f253398350, user_id=e574502912b24da3822a937b9a1a8623, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.625191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.639608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1002/2009] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:55 2022] PUT /identity/v3/projects/497486265b474f0db9cdb1f253398350/users/e574502912b24da3822a937b9a1a8623/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:55.651012 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fab0b-3ab2-4e1b-b60a-cd065381000e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.651294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fab0b-3ab2-4e1b-b60a-cd065381000e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.651591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fab0b-3ab2-4e1b-b60a-cd065381000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.682282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-070fab0b-3ab2-4e1b-b60a-cd065381000e None None] MFA Rules not processed for user `e574502912b24da3822a937b9a1a8623`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:55.683490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-070fab0b-3ab2-4e1b-b60a-cd065381000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:55.710219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:55.713299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.715295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:55.793686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1008/2010] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:55.798706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fab0b-3ab2-4e1b-b60a-cd065381000e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.808265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77937a72-4566-4541-b867-9b05c3d8946a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.813484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fab0b-3ab2-4e1b-b60a-cd065381000e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.816277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.817188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.817479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.817762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] PATH_INFO: `/v3/users/e0e7f58b6a2d4ed4837168857a61912f` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.818274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa682-ec91-495f-98c6-2f94864d4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.818900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa682-ec91-495f-98c6-2f94864d4be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.819169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa682-ec91-495f-98c6-2f94864d4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.819341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e7f58b6a2d4ed4837168857a61912f)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.819466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa682-ec91-495f-98c6-2f94864d4be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.820085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aa682-ec91-495f-98c6-2f94864d4be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.821638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.823152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aa682-ec91-495f-98c6-2f94864d4be4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.831699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:55.867971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1009/2011] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:55 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:55.872469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa682-ec91-495f-98c6-2f94864d4be4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.902423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e7f58b6a2d4ed4837168857a61912f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.903263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e7f58b6a2d4ed4837168857a61912f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.919698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e7f58b6a2d4ed4837168857a61912f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.932765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e7f58b6a2d4ed4837168857a61912f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.933660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-615257ed-be83-4696-8c2a-c732cf3edd1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e7f58b6a2d4ed4837168857a61912f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:55.948134 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1003/2012] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:55 2022] DELETE /identity/v3/users/e0e7f58b6a2d4ed4837168857a61912f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:55.953513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59df3-4a79-4f34-9eb0-64211120fd9b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.953800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59df3-4a79-4f34-9eb0-64211120fd9b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.954111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59df3-4a79-4f34-9eb0-64211120fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.957788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa682-ec91-495f-98c6-2f94864d4be4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.973652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8fd59df3-4a79-4f34-9eb0-64211120fd9b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:55.974903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8fd59df3-4a79-4f34-9eb0-64211120fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.045288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.045968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.046254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.046530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.047174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.050545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1004/2013] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:56.050677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.057430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd59df3-4a79-4f34-9eb0-64211120fd9b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.058959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8fd59df3-4a79-4f34-9eb0-64211120fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.091334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1010/2014] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:55 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:56.096025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.099230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.121459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3dd99-5b43-4af7-946f-60a88ef0ff7d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.132345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf000-4946-4fe5-8beb-4ac0f6cca535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.133059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf000-4946-4fe5-8beb-4ac0f6cca535 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.136005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf000-4946-4fe5-8beb-4ac0f6cca535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.136005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bf000-4946-4fe5-8beb-4ac0f6cca535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.136866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bf000-4946-4fe5-8beb-4ac0f6cca535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.139087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bf000-4946-4fe5-8beb-4ac0f6cca535 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.151731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1011/2015] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:56.156763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf000-4946-4fe5-8beb-4ac0f6cca535 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.164795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd59df3-4a79-4f34-9eb0-64211120fd9b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.169607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bf000-4946-4fe5-8beb-4ac0f6cca535 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.171686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae059f-9f79-482d-9539-2a9246b6e773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.172317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae059f-9f79-482d-9539-2a9246b6e773 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.172600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae059f-9f79-482d-9539-2a9246b6e773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.172877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae059f-9f79-482d-9539-2a9246b6e773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.176971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.177877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.178401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.178740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] PATH_INFO: `/v3/projects/1148b05103a144ae868c885903f06f6f/users/3f2f188234c64207a5a28a4c4007f0cc/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.191993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae059f-9f79-482d-9539-2a9246b6e773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.193521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae059f-9f79-482d-9539-2a9246b6e773 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.197974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1148b05103a144ae868c885903f06f6f, user_id=3f2f188234c64207a5a28a4c4007f0cc, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.200776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.204726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1005/2016] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:56.222403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1012/2017] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:56 2022] PUT /identity/v3/projects/1148b05103a144ae868c885903f06f6f/users/3f2f188234c64207a5a28a4c4007f0cc/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:56.226904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae059f-9f79-482d-9539-2a9246b6e773 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.239039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae059f-9f79-482d-9539-2a9246b6e773 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.271433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:56.313516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442987-7499-44de-a4d9-9bd4b7adf134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.314255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442987-7499-44de-a4d9-9bd4b7adf134 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.314625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442987-7499-44de-a4d9-9bd4b7adf134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.314919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442987-7499-44de-a4d9-9bd4b7adf134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.315636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6442987-7499-44de-a4d9-9bd4b7adf134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.317885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6442987-7499-44de-a4d9-9bd4b7adf134 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.323875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.325622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.333784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:56.338328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1006/2018] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:56.339516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442987-7499-44de-a4d9-9bd4b7adf134 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.339667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d664575-9a28-4a4a-847b-2e5545fb14cd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.347892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.348811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.349666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.349666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] PATH_INFO: `/v3/users/3dc9d7364de641a5a57aefb36c20d191` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.349928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442987-7499-44de-a4d9-9bd4b7adf134 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.350854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc9d7364de641a5a57aefb36c20d191)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.352890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.354708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05b02-efae-494b-a15b-a2452f8169fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.355361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05b02-efae-494b-a15b-a2452f8169fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.355645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05b02-efae-494b-a15b-a2452f8169fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.355917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05b02-efae-494b-a15b-a2452f8169fd admin admin] PATH_INFO: `/v3/projects/1148b05103a144ae868c885903f06f6f/users/3f2f188234c64207a5a28a4c4007f0cc/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.358616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05b02-efae-494b-a15b-a2452f8169fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1148b05103a144ae868c885903f06f6f, user_id=3f2f188234c64207a5a28a4c4007f0cc, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.361266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05b02-efae-494b-a15b-a2452f8169fd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.390431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1007/2019] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:56 2022] PUT /identity/v3/projects/1148b05103a144ae868c885903f06f6f/users/3f2f188234c64207a5a28a4c4007f0cc/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:56.400624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb66f2-eeef-4009-93c9-d03fcd687a02 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.400910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb66f2-eeef-4009-93c9-d03fcd687a02 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.401199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb66f2-eeef-4009-93c9-d03fcd687a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.454262 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-d9cb66f2-eeef-4009-93c9-d03fcd687a02 None None] MFA Rules not processed for user `3f2f188234c64207a5a28a4c4007f0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:56.456723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d9cb66f2-eeef-4009-93c9-d03fcd687a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.462501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc9d7364de641a5a57aefb36c20d191'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.463510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc9d7364de641a5a57aefb36c20d191'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.478502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc9d7364de641a5a57aefb36c20d191'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.490557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc9d7364de641a5a57aefb36c20d191'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.495719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-070c8b71-7340-4022-b030-8e3000945700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc9d7364de641a5a57aefb36c20d191'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.517946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1013/2020] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:56 2022] DELETE /identity/v3/users/3dc9d7364de641a5a57aefb36c20d191 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:56.520220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423e8f-9db4-41a2-8e83-9dff2620de47 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.520621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423e8f-9db4-41a2-8e83-9dff2620de47 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.521119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423e8f-9db4-41a2-8e83-9dff2620de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.557942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1008/2021] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:56.568981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ce423e8f-9db4-41a2-8e83-9dff2620de47 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:56.571335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce423e8f-9db4-41a2-8e83-9dff2620de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.581226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb66f2-eeef-4009-93c9-d03fcd687a02 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.585260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d9cb66f2-eeef-4009-93c9-d03fcd687a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.658303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1014/2022] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:56.664421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423e8f-9db4-41a2-8e83-9dff2620de47 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.666069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce423e8f-9db4-41a2-8e83-9dff2620de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.676077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb66f2-eeef-4009-93c9-d03fcd687a02 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.681116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423e8f-9db4-41a2-8e83-9dff2620de47 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.686802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.687634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.688074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.688351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] PATH_INFO: `/v3/projects/a49a8ec55cab441a97d9da4a261b73e1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.689491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49a8ec55cab441a97d9da4a261b73e1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.691489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.745350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6904ee-291b-4621-b9d1-373dd6383dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.746022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6904ee-291b-4621-b9d1-373dd6383dcb service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.746333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6904ee-291b-4621-b9d1-373dd6383dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.748450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6904ee-291b-4621-b9d1-373dd6383dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.752092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49a8ec55cab441a97d9da4a261b73e1', 'request_id': 'req-30230299-5b5b-4fd0-96c3-fe63a8325440'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.753418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:56.760345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49a8ec55cab441a97d9da4a261b73e1', 'request_id': 'req-30230299-5b5b-4fd0-96c3-fe63a8325440'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.767182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49a8ec55cab441a97d9da4a261b73e1', 'request_id': 'req-30230299-5b5b-4fd0-96c3-fe63a8325440'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.774219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:56.779505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] The token cache is being invalidate because project a49a8ec55cab441a97d9da4a261b73e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:56.780118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.781208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:56.783079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1015/2023] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:56 2022] DELETE /identity/v3/projects/a49a8ec55cab441a97d9da4a261b73e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:56.786689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.788047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.820332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6904ee-291b-4621-b9d1-373dd6383dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.822003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6904ee-291b-4621-b9d1-373dd6383dcb service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.834281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1009/2024] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:56.835204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6904ee-291b-4621-b9d1-373dd6383dcb service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.846822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6904ee-291b-4621-b9d1-373dd6383dcb service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.869530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230299-5b5b-4fd0-96c3-fe63a8325440 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.875574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.876200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.876483 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.876754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.878754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.948270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.949113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.949539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.950526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] PATH_INFO: `/v3/users/87ddf452021f495f85a5778b5f89e85c` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.951870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ddf452021f495f85a5778b5f89e85c)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.953868 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.963168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.964644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.975401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1016/2025] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:57.014795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ddf452021f495f85a5778b5f89e85c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.015850 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ddf452021f495f85a5778b5f89e85c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.047605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ddf452021f495f85a5778b5f89e85c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.055908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ddf452021f495f85a5778b5f89e85c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.056639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ddf452021f495f85a5778b5f89e85c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.077487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1010/2026] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:56 2022] DELETE /identity/v3/users/87ddf452021f495f85a5778b5f89e85c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:57.356613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.358751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:57.380049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fc069-4062-477e-b5a8-e4e3eff51593 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:57.417129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.419753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:57.461028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:57.478513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:57.480432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.480432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.480633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] PATH_INFO: `/v3/projects/db0bbe9bfd1a4423ac7deddf2bf962af` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.481974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0bbe9bfd1a4423ac7deddf2bf962af)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:57.484912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:57.581450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0bbe9bfd1a4423ac7deddf2bf962af', 'request_id': 'req-577a0909-8c1c-445c-bc3b-97335e106b84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.583324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e28736-288e-45fb-b476-dd071ce66aee admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:57.585818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:57.600437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0bbe9bfd1a4423ac7deddf2bf962af', 'request_id': 'req-577a0909-8c1c-445c-bc3b-97335e106b84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.619122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0bbe9bfd1a4423ac7deddf2bf962af', 'request_id': 'req-577a0909-8c1c-445c-bc3b-97335e106b84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.634050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] The token cache is being invalidate because project db0bbe9bfd1a4423ac7deddf2bf962af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:57.634415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.635248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.640210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1017/2027] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:57 2022] DELETE /identity/v3/projects/db0bbe9bfd1a4423ac7deddf2bf962af => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:57.641434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.643371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:57.706804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:57.707481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.708866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.709150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] PATH_INFO: `/v3/users/642da1eb361f451892caf47abb07c612` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.711456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642da1eb361f451892caf47abb07c612)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:57.715872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:57.742384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a0909-8c1c-445c-bc3b-97335e106b84 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:57.749704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:57.751388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.751869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.752253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] PATH_INFO: `/v3/projects/ab3d3b2ebd24404d94cae9f30a337b5f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.754120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3d3b2ebd24404d94cae9f30a337b5f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:57.757894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:57.845624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642da1eb361f451892caf47abb07c612'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.847580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642da1eb361f451892caf47abb07c612'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.868066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3d3b2ebd24404d94cae9f30a337b5f', 'request_id': 'req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.879752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642da1eb361f451892caf47abb07c612'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.887138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3d3b2ebd24404d94cae9f30a337b5f', 'request_id': 'req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.894690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3d3b2ebd24404d94cae9f30a337b5f', 'request_id': 'req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.899003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642da1eb361f451892caf47abb07c612'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.900260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642da1eb361f451892caf47abb07c612'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.920303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] The token cache is being invalidate because project ab3d3b2ebd24404d94cae9f30a337b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:57.920303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.922854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-362ab6fa-ff2c-4b1a-93a6-b24f2426fcdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.931979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1011/2028] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:57 2022] DELETE /identity/v3/users/642da1eb361f451892caf47abb07c612 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:57.931979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.932396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1018/2029] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:57 2022] DELETE /identity/v3/projects/ab3d3b2ebd24404d94cae9f30a337b5f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:57.933641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:57.936732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3a6f6-008e-4ef1-a7e2-04fcc56b5c93 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.940166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3a6f6-008e-4ef1-a7e2-04fcc56b5c93 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.941380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3a6f6-008e-4ef1-a7e2-04fcc56b5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.993274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-10f3a6f6-008e-4ef1-a7e2-04fcc56b5c93 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:57.995096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10f3a6f6-008e-4ef1-a7e2-04fcc56b5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:58.039193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:58.063003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58145-3355-4b5d-bc52-cd7da56f7c96 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.070535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.071319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.071604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.071929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] PATH_INFO: `/v3/users/6dba335cb1684289bc9ae982355f7e82` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.075919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dba335cb1684289bc9ae982355f7e82)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.081392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.086838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1019/2030] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:58.089060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189bb9-35b5-4de2-8ddc-be4b41ba0426 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.089523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189bb9-35b5-4de2-8ddc-be4b41ba0426 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.090205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189bb9-35b5-4de2-8ddc-be4b41ba0426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.119069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-64189bb9-35b5-4de2-8ddc-be4b41ba0426 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:58.121259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-64189bb9-35b5-4de2-8ddc-be4b41ba0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:58.160486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1020/2031] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:58.160486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189bb9-35b5-4de2-8ddc-be4b41ba0426 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.160486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-64189bb9-35b5-4de2-8ddc-be4b41ba0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:58.161521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:58.177338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dba335cb1684289bc9ae982355f7e82'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:58.178184 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dba335cb1684289bc9ae982355f7e82'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:58.192680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dba335cb1684289bc9ae982355f7e82'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:58.203854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dba335cb1684289bc9ae982355f7e82'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:58.204713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7f728df5-a987-4adc-8872-57eaf3aa70bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dba335cb1684289bc9ae982355f7e82'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:58.221726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1012/2032] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:57 2022] DELETE /identity/v3/users/6dba335cb1684289bc9ae982355f7e82 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:58.223335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a58a5-5340-48fe-81d9-0d7370f0ef2e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.223719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a58a5-5340-48fe-81d9-0d7370f0ef2e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.224117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a58a5-5340-48fe-81d9-0d7370f0ef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.268828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189bb9-35b5-4de2-8ddc-be4b41ba0426 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.285610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-802a58a5-5340-48fe-81d9-0d7370f0ef2e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:58.287847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-802a58a5-5340-48fe-81d9-0d7370f0ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:58.366693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.367320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.367599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.368122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.370246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:58.404939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1013/2033] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:58.409698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a58a5-5340-48fe-81d9-0d7370f0ef2e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.434310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a58a5-5340-48fe-81d9-0d7370f0ef2e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.462641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.463283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.463561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.463857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.478272 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:58.478272 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.478272 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.501880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1014/2034] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:58.507308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.523926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd020-582e-43be-8cf5-6cb644872595 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.529052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3f194-36d0-420a-a359-a693610fdd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.529686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f194-36d0-420a-a359-a693610fdd36 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.530083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f194-36d0-420a-a359-a693610fdd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.530589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f194-36d0-420a-a359-a693610fdd36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.531235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3f194-36d0-420a-a359-a693610fdd36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.533806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3f194-36d0-420a-a359-a693610fdd36 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.539433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.542133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.563468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1021/2035] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:58.607615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1015/2036] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:58.612422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.641789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0cfb9-5cac-4ccc-9eec-d10b58c52b4d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.757298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b722f66-2848-4ad6-8cc9-2436b27ce92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.759210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b722f66-2848-4ad6-8cc9-2436b27ce92d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.760224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b722f66-2848-4ad6-8cc9-2436b27ce92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.761068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b722f66-2848-4ad6-8cc9-2436b27ce92d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.762904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b722f66-2848-4ad6-8cc9-2436b27ce92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.767287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b722f66-2848-4ad6-8cc9-2436b27ce92d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.808351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:58.825126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1022/2037] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:58.830804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3f194-36d0-420a-a359-a693610fdd36 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.845030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3f194-36d0-420a-a359-a693610fdd36 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.850795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.851540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.851813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.852149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.852822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.855494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.873762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1016/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:58.880130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b722f66-2848-4ad6-8cc9-2436b27ce92d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.884530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.890350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:58.892035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b722f66-2848-4ad6-8cc9-2436b27ce92d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.903368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a709b-3ed9-42c0-b765-6ad2d8fdae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.904077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a709b-3ed9-42c0-b765-6ad2d8fdae13 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.904471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a709b-3ed9-42c0-b765-6ad2d8fdae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.904995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a709b-3ed9-42c0-b765-6ad2d8fdae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.905509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a709b-3ed9-42c0-b765-6ad2d8fdae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.908512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a709b-3ed9-42c0-b765-6ad2d8fdae13 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.921402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6f8d4-416e-49a4-b81c-190ac921b5cb admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.936325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1023/2039] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:58.936325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a709b-3ed9-42c0-b765-6ad2d8fdae13 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.939053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.939909 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.940316 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.940701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] PATH_INFO: `/v3/projects/36860c9cdef64c91a23c7460b52012bd` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.943364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36860c9cdef64c91a23c7460b52012bd)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.945458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.976143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a709b-3ed9-42c0-b765-6ad2d8fdae13 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.986009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.987847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.988370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.988745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] PATH_INFO: `/v3/projects/8290761e8387437195fd23557f630b5e/users/a7463bb9b4a649b4b83bbab4017eb439/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.008084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:59.032456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8290761e8387437195fd23557f630b5e, user_id=a7463bb9b4a649b4b83bbab4017eb439, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.039639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.068296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1024/2040] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:58 2022] PUT /identity/v3/projects/8290761e8387437195fd23557f630b5e/users/a7463bb9b4a649b4b83bbab4017eb439/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:59.078165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.078165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.087744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36860c9cdef64c91a23c7460b52012bd', 'request_id': 'req-a8ef148b-a932-4ca0-920f-33240be865b0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.099621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36860c9cdef64c91a23c7460b52012bd', 'request_id': 'req-a8ef148b-a932-4ca0-920f-33240be865b0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.117279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36860c9cdef64c91a23c7460b52012bd', 'request_id': 'req-a8ef148b-a932-4ca0-920f-33240be865b0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.164935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] The token cache is being invalidate because project 36860c9cdef64c91a23c7460b52012bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:59.165870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.167036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a8ef148b-a932-4ca0-920f-33240be865b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.169079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1017/2041] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:58 2022] DELETE /identity/v3/projects/36860c9cdef64c91a23c7460b52012bd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:59.170538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19a70-bd7f-4f82-bb2b-c356365dfade None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.170932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19a70-bd7f-4f82-bb2b-c356365dfade None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.171295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19a70-bd7f-4f82-bb2b-c356365dfade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.212199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-76f19a70-bd7f-4f82-bb2b-c356365dfade None None] MFA Rules not processed for user `a7463bb9b4a649b4b83bbab4017eb439`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:59.213734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-76f19a70-bd7f-4f82-bb2b-c356365dfade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.246850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30765b1-bb3d-4843-9f95-c85de7640800 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.253361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.254045 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.254770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.255053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] PATH_INFO: `/v3/users/e574502912b24da3822a937b9a1a8623` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.256674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e574502912b24da3822a937b9a1a8623)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.258771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.318825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e574502912b24da3822a937b9a1a8623'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.319560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e574502912b24da3822a937b9a1a8623'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.333689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e574502912b24da3822a937b9a1a8623'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.345742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e574502912b24da3822a937b9a1a8623'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.346583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e574502912b24da3822a937b9a1a8623'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.348962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1018/2042] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:59.351714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd06d30-faf9-47b7-b7ce-1a67d7502fea None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.352115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd06d30-faf9-47b7-b7ce-1a67d7502fea None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.352487 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd06d30-faf9-47b7-b7ce-1a67d7502fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.363210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1025/2043] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:59 2022] DELETE /identity/v3/users/e574502912b24da3822a937b9a1a8623 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:59.364285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.366214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.390425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-6bd06d30-faf9-47b7-b7ce-1a67d7502fea None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:59.392084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6bd06d30-faf9-47b7-b7ce-1a67d7502fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.421470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:59.445559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafac66-3b2a-4f90-99f8-6309faf5cbbb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.451675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.452455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.452736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.453016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] PATH_INFO: `/v3/projects/1aeafa9cbfe04311b9258a88518252ae` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.454250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aeafa9cbfe04311b9258a88518252ae)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.458103 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.486683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1019/2044] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:59.488564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd06d30-faf9-47b7-b7ce-1a67d7502fea None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.489252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6bd06d30-faf9-47b7-b7ce-1a67d7502fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.512723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd06d30-faf9-47b7-b7ce-1a67d7502fea None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.535393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aeafa9cbfe04311b9258a88518252ae', 'request_id': 'req-612818d7-f553-4fa0-ac68-dcb1be4360f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.564568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aeafa9cbfe04311b9258a88518252ae', 'request_id': 'req-612818d7-f553-4fa0-ac68-dcb1be4360f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.569304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:59.577594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aeafa9cbfe04311b9258a88518252ae', 'request_id': 'req-612818d7-f553-4fa0-ac68-dcb1be4360f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.595870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] The token cache is being invalidate because project 1aeafa9cbfe04311b9258a88518252ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:59.596256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.597063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-612818d7-f553-4fa0-ac68-dcb1be4360f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.601592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1026/2045] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:59 2022] DELETE /identity/v3/projects/1aeafa9cbfe04311b9258a88518252ae => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:59.601592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66de5-d0a5-459f-9b26-e81602bd2d1e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.601592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66de5-d0a5-459f-9b26-e81602bd2d1e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.601592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66de5-d0a5-459f-9b26-e81602bd2d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.621784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.622529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.623422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.624703 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.625401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.629606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.633875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-64b66de5-d0a5-459f-9b26-e81602bd2d1e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:59.635112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-64b66de5-d0a5-459f-9b26-e81602bd2d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.657594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1027/2046] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:59.659145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a52c-4089-45a0-8092-b44e2ade9cf7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.659474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a52c-4089-45a0-8092-b44e2ade9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.659741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118a52c-4089-45a0-8092-b44e2ade9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.687836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6118a52c-4089-45a0-8092-b44e2ade9cf7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:59.690963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1020/2047] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:59 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:59.690963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.691200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6118a52c-4089-45a0-8092-b44e2ade9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.691293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.767867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1028/2048] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:59.769195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a52c-4089-45a0-8092-b44e2ade9cf7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.770090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6118a52c-4089-45a0-8092-b44e2ade9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.789320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c729d78-8635-420f-8811-7c3c455ff511 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.796672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.797743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.798343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.798622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] PATH_INFO: `/v3/users/8782f9b5d74c4893bba4190f4cbdbb5e` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.799911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8782f9b5d74c4893bba4190f4cbdbb5e)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.802052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.833041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118a52c-4089-45a0-8092-b44e2ade9cf7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.840086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.840718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.840996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.841346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.851546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.852981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.856313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8782f9b5d74c4893bba4190f4cbdbb5e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.857885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8782f9b5d74c4893bba4190f4cbdbb5e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.863238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1029/2049] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:59.863992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.865534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.875800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8782f9b5d74c4893bba4190f4cbdbb5e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.879650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130763e-1a4d-4689-b010-b6faea5c9df7 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.884753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.885521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.885799 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.886106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.886549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8782f9b5d74c4893bba4190f4cbdbb5e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.886732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.887600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8782f9b5d74c4893bba4190f4cbdbb5e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.888792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.898922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:59.905068 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1021/2050] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:59 2022] DELETE /identity/v3/users/8782f9b5d74c4893bba4190f4cbdbb5e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:59.905993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.907628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.917413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1030/2051] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:59 2022] POST /identity/v3/users => generated 300 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:59.922722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.930955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.949437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b2cc4-4582-4e5a-97e9-15c9a8fcd72e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.966923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:59.998959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27692d-19cd-4b68-8cd0-20fe063a2ff4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.007712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.009853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.010189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.010468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.011152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:00.011485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.013893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.029669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1022/2052] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:00.036133 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.039757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115efd3-6516-4547-a862-f80d1f29c732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.040604 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115efd3-6516-4547-a862-f80d1f29c732 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.041033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115efd3-6516-4547-a862-f80d1f29c732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.041476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115efd3-6516-4547-a862-f80d1f29c732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.042504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115efd3-6516-4547-a862-f80d1f29c732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.044334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115efd3-6516-4547-a862-f80d1f29c732 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.049202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8d490-37f0-4832-9378-4bf1c9c509a4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.055001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171da2ad-6dc5-4385-8e07-5c8df55c080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.055811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171da2ad-6dc5-4385-8e07-5c8df55c080e admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.056348 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171da2ad-6dc5-4385-8e07-5c8df55c080e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.056878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171da2ad-6dc5-4385-8e07-5c8df55c080e admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.057661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171da2ad-6dc5-4385-8e07-5c8df55c080e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.059696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1031/2053] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:00.059844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171da2ad-6dc5-4385-8e07-5c8df55c080e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.063504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115efd3-6516-4547-a862-f80d1f29c732 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.076500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115efd3-6516-4547-a862-f80d1f29c732 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.083064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40029d-df38-4dd1-b631-67c008edc1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.084334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40029d-df38-4dd1-b631-67c008edc1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.084630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40029d-df38-4dd1-b631-67c008edc1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.084911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40029d-df38-4dd1-b631-67c008edc1ff admin admin] PATH_INFO: `/v3/projects/e7618cb752f04b1199c386d8a1ce8407/users/5f6794498fcc4f89b6e4a2782f4a578f/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.111347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40029d-df38-4dd1-b631-67c008edc1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7618cb752f04b1199c386d8a1ce8407, user_id=5f6794498fcc4f89b6e4a2782f4a578f, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.114083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40029d-df38-4dd1-b631-67c008edc1ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.116332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1023/2054] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:00 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:00.118609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171da2ad-6dc5-4385-8e07-5c8df55c080e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.153374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1032/2055] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:00 2022] PUT /identity/v3/projects/e7618cb752f04b1199c386d8a1ce8407/users/5f6794498fcc4f89b6e4a2782f4a578f/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:00.158593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40029d-df38-4dd1-b631-67c008edc1ff admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.296738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171da2ad-6dc5-4385-8e07-5c8df55c080e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.297116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40029d-df38-4dd1-b631-67c008edc1ff admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.308137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f368-9763-4947-a0ac-4bbc281b826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.308795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f368-9763-4947-a0ac-4bbc281b826e admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.309338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f368-9763-4947-a0ac-4bbc281b826e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.309438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f368-9763-4947-a0ac-4bbc281b826e admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.310834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934f368-9763-4947-a0ac-4bbc281b826e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.317193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934f368-9763-4947-a0ac-4bbc281b826e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.317372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087620a-0826-42bc-91d9-987ebea32885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.318822 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087620a-0826-42bc-91d9-987ebea32885 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.319124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087620a-0826-42bc-91d9-987ebea32885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.319402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087620a-0826-42bc-91d9-987ebea32885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.320209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087620a-0826-42bc-91d9-987ebea32885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.323542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087620a-0826-42bc-91d9-987ebea32885 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.340744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1033/2056] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:00.344752 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087620a-0826-42bc-91d9-987ebea32885 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.361723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087620a-0826-42bc-91d9-987ebea32885 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.368934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1024/2057] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:00 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:00.373194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f368-9763-4947-a0ac-4bbc281b826e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.393142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f368-9763-4947-a0ac-4bbc281b826e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.393762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.394367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.394792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.395069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] PATH_INFO: `/v3/projects/e7618cb752f04b1199c386d8a1ce8407/users/5f6794498fcc4f89b6e4a2782f4a578f/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.397066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7618cb752f04b1199c386d8a1ce8407, user_id=5f6794498fcc4f89b6e4a2782f4a578f, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.399599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95e3ae-e732-4d7e-a832-445a68d3a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.400214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e3ae-e732-4d7e-a832-445a68d3a527 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.400504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e3ae-e732-4d7e-a832-445a68d3a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.400862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95e3ae-e732-4d7e-a832-445a68d3a527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.401496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95e3ae-e732-4d7e-a832-445a68d3a527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.402785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.403229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95e3ae-e732-4d7e-a832-445a68d3a527 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.426718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1034/2058] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:00 2022] PUT /identity/v3/projects/e7618cb752f04b1199c386d8a1ce8407/users/5f6794498fcc4f89b6e4a2782f4a578f/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:00.426718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.426718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.426990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1025/2059] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:00.427196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95e3ae-e732-4d7e-a832-445a68d3a527 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.444543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95e3ae-e732-4d7e-a832-445a68d3a527 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.516753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:00.537594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d293d36-76e4-4e7d-99fe-3de0a9b8487e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.538616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b001a0-d9d6-4eab-9679-d069b3d588c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.539501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b001a0-d9d6-4eab-9679-d069b3d588c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.539850 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b001a0-d9d6-4eab-9679-d069b3d588c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.540328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b001a0-d9d6-4eab-9679-d069b3d588c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.541108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b001a0-d9d6-4eab-9679-d069b3d588c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.543118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b001a0-d9d6-4eab-9679-d069b3d588c0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.547116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.547891 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.548182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.548465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] PATH_INFO: `/v3/projects/035e3f371fda4347955712cd1a68b209` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.550111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035e3f371fda4347955712cd1a68b209)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.559439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1026/2060] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:00.562000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422ce5-7bd4-49c3-8816-1d38443977b5 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.562692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422ce5-7bd4-49c3-8816-1d38443977b5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.563131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422ce5-7bd4-49c3-8816-1d38443977b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.563252 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.604982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-de422ce5-7bd4-49c3-8816-1d38443977b5 None None] MFA Rules not processed for user `5f6794498fcc4f89b6e4a2782f4a578f`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:00.606500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-de422ce5-7bd4-49c3-8816-1d38443977b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.624161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:00.627290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035e3f371fda4347955712cd1a68b209', 'request_id': 'req-af001983-183e-4226-9f1b-cc94eeba06e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.635493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035e3f371fda4347955712cd1a68b209', 'request_id': 'req-af001983-183e-4226-9f1b-cc94eeba06e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.642728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035e3f371fda4347955712cd1a68b209', 'request_id': 'req-af001983-183e-4226-9f1b-cc94eeba06e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.655657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] The token cache is being invalidate because project 035e3f371fda4347955712cd1a68b209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:00.655849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.656508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.658049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1035/2061] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:00 2022] DELETE /identity/v3/projects/035e3f371fda4347955712cd1a68b209 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:00.658867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.660154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.688869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1027/2062] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:00.688869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422ce5-7bd4-49c3-8816-1d38443977b5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.689897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-de422ce5-7bd4-49c3-8816-1d38443977b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.732775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af001983-183e-4226-9f1b-cc94eeba06e8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.737601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8d4c0-cc37-4129-8104-3e0f97f6af12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.738334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8d4c0-cc37-4129-8104-3e0f97f6af12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.738668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8d4c0-cc37-4129-8104-3e0f97f6af12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.738998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8d4c0-cc37-4129-8104-3e0f97f6af12 admin admin] PATH_INFO: `/v3/projects/759b7d6ae1dd49bb888b6325b7d3db76/users/7b366ccd93a04525aaa2ce5f1662d4c4/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.755740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8d4c0-cc37-4129-8104-3e0f97f6af12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759b7d6ae1dd49bb888b6325b7d3db76, user_id=7b366ccd93a04525aaa2ce5f1662d4c4, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.758604 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8d4c0-cc37-4129-8104-3e0f97f6af12 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.762001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422ce5-7bd4-49c3-8816-1d38443977b5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.767953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.768745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.769396 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.769396 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] PATH_INFO: `/v3/projects/497486265b474f0db9cdb1f253398350` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.770534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=497486265b474f0db9cdb1f253398350)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.772478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.785344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1036/2063] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:00 2022] PUT /identity/v3/projects/759b7d6ae1dd49bb888b6325b7d3db76/users/7b366ccd93a04525aaa2ce5f1662d4c4/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:00.785344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176b462-08e8-49b3-b164-de7519fa8bb5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.785344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176b462-08e8-49b3-b164-de7519fa8bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.785344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176b462-08e8-49b3-b164-de7519fa8bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.803560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a176b462-08e8-49b3-b164-de7519fa8bb5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:00.805503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a176b462-08e8-49b3-b164-de7519fa8bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.866489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497486265b474f0db9cdb1f253398350', 'request_id': 'req-f46c8eb5-1e12-4626-bda6-62b0657aa805'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.874878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497486265b474f0db9cdb1f253398350', 'request_id': 'req-f46c8eb5-1e12-4626-bda6-62b0657aa805'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.880171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:00.885573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497486265b474f0db9cdb1f253398350', 'request_id': 'req-f46c8eb5-1e12-4626-bda6-62b0657aa805'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.903803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1037/2064] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:00.905939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176b462-08e8-49b3-b164-de7519fa8bb5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.907268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a176b462-08e8-49b3-b164-de7519fa8bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.913144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] The token cache is being invalidate because project 497486265b474f0db9cdb1f253398350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:00.913435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.914786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f46c8eb5-1e12-4626-bda6-62b0657aa805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:00.916729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1028/2065] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:00 2022] DELETE /identity/v3/projects/497486265b474f0db9cdb1f253398350 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:00.918455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8ae13-d810-4230-9d4e-5d3292d2cb37 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.918762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8ae13-d810-4230-9d4e-5d3292d2cb37 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.919042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8ae13-d810-4230-9d4e-5d3292d2cb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.959231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-79c8ae13-d810-4230-9d4e-5d3292d2cb37 None None] MFA Rules not processed for user `7b366ccd93a04525aaa2ce5f1662d4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:00.960687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-79c8ae13-d810-4230-9d4e-5d3292d2cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.975680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176b462-08e8-49b3-b164-de7519fa8bb5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.993608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:01.036152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.037396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.037757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.038140 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.040646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.047931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1029/2066] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:01.050390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d203-c092-4dbe-9c19-b3f1ec2ede26 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.050912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d203-c092-4dbe-9c19-b3f1ec2ede26 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.051195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d203-c092-4dbe-9c19-b3f1ec2ede26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.070577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-89d0d203-c092-4dbe-9c19-b3f1ec2ede26 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:01.071790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-89d0d203-c092-4dbe-9c19-b3f1ec2ede26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.120951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.128169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.135907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1038/2067] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:01.136689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.139326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.163723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1030/2068] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:01.164560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0d203-c092-4dbe-9c19-b3f1ec2ede26 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.165865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-89d0d203-c092-4dbe-9c19-b3f1ec2ede26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.179312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0d203-c092-4dbe-9c19-b3f1ec2ede26 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.184219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33f810-09cd-4fde-b685-30b6d6710459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.184828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33f810-09cd-4fde-b685-30b6d6710459 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.185106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33f810-09cd-4fde-b685-30b6d6710459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.185425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33f810-09cd-4fde-b685-30b6d6710459 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.186086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33f810-09cd-4fde-b685-30b6d6710459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.188610 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33f810-09cd-4fde-b685-30b6d6710459 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.234796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1031/2069] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:01 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:01.236386 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33f810-09cd-4fde-b685-30b6d6710459 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.263006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4617b-9150-451d-bdbf-7274e641e30e service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.275669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:01.346612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33f810-09cd-4fde-b685-30b6d6710459 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.347746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.348379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.348662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.348938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] PATH_INFO: `/v3/users/3f2f188234c64207a5a28a4c4007f0cc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.350093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2f188234c64207a5a28a4c4007f0cc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.351403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.352014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.352109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.352294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.352565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.353208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:01.353687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.355649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.368201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1032/2070] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:01.368201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.379937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c395f03-f582-4559-988e-d9a96f1d0bee admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.385046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.385657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.385966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.386249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.387352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.388885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.405919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2f188234c64207a5a28a4c4007f0cc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.406592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2f188234c64207a5a28a4c4007f0cc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.413524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1033/2071] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:01 2022] POST /identity/v3/users => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:01.413524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.415001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.418979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2f188234c64207a5a28a4c4007f0cc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.426714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2f188234c64207a5a28a4c4007f0cc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.427269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2f188234c64207a5a28a4c4007f0cc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.429284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3b0bc-76f0-4b54-a773-047a625c53dd admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.434240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.434872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.435211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.435528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] PATH_INFO: `/v3/users/a7463bb9b4a649b4b83bbab4017eb439` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.437011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7463bb9b4a649b4b83bbab4017eb439)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.439168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.440213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1039/2072] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:01 2022] DELETE /identity/v3/users/3f2f188234c64207a5a28a4c4007f0cc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:01.446109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.446109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.472454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:01.521451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7463bb9b4a649b4b83bbab4017eb439'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.522273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7463bb9b4a649b4b83bbab4017eb439'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.537770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfa039-3e72-4d47-942a-9b266270c350 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.541331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.542141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.542471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.542709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.543718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.546275 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.562627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7463bb9b4a649b4b83bbab4017eb439'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.573680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7463bb9b4a649b4b83bbab4017eb439'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.574929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7463bb9b4a649b4b83bbab4017eb439'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:01.588214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1040/2073] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:01 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:01.589138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.601907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.602866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1034/2074] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:01 2022] DELETE /identity/v3/users/a7463bb9b4a649b4b83bbab4017eb439 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:01.602866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.602866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.629885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:01.708148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773aa52-4e61-4a02-80eb-7a1054a35a24 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.713884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755a4e2-6459-4e3a-b2f7-03b543db60f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.714807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a4e2-6459-4e3a-b2f7-03b543db60f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.715151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a4e2-6459-4e3a-b2f7-03b543db60f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.715740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a4e2-6459-4e3a-b2f7-03b543db60f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.716940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755a4e2-6459-4e3a-b2f7-03b543db60f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.718874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0b583-27bb-43f8-ae2a-6c728bb83ac0 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.719098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755a4e2-6459-4e3a-b2f7-03b543db60f1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.727151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0230e-49f0-4b2d-89c5-f72ef47556c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.727881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0230e-49f0-4b2d-89c5-f72ef47556c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.728259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0230e-49f0-4b2d-89c5-f72ef47556c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.728633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0230e-49f0-4b2d-89c5-f72ef47556c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.734402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0230e-49f0-4b2d-89c5-f72ef47556c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.735024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0230e-49f0-4b2d-89c5-f72ef47556c1 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.742368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1041/2075] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:01.745092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5124-4d35-42d1-bc7c-780b36cf729a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.745526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5124-4d35-42d1-bc7c-780b36cf729a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.745809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5124-4d35-42d1-bc7c-780b36cf729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.767580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1035/2076] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:01 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:01.768407 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0230e-49f0-4b2d-89c5-f72ef47556c1 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.772956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-595e5124-4d35-42d1-bc7c-780b36cf729a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:01.774635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-595e5124-4d35-42d1-bc7c-780b36cf729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.794028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1042/2077] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:01.794028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e5124-4d35-42d1-bc7c-780b36cf729a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.794639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0230e-49f0-4b2d-89c5-f72ef47556c1 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.804655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e5124-4d35-42d1-bc7c-780b36cf729a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.807393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb8c4-edff-4362-820e-c0d53dcca7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.808228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb8c4-edff-4362-820e-c0d53dcca7be admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.808513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb8c4-edff-4362-820e-c0d53dcca7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.808792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deb8c4-edff-4362-820e-c0d53dcca7be admin admin] PATH_INFO: `/v3/projects/37e581e2dacb44e298e366e44a08e36e/users/c7f7b8a0340946a3a2ba6479edaf3300/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.814775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.815511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.815917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.816266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.816996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.818790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.828122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deb8c4-edff-4362-820e-c0d53dcca7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e581e2dacb44e298e366e44a08e36e, user_id=c7f7b8a0340946a3a2ba6479edaf3300, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.831464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deb8c4-edff-4362-820e-c0d53dcca7be admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.831582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1043/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:01.832254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.836477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.860474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1036/2079] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:01 2022] PUT /identity/v3/projects/37e581e2dacb44e298e366e44a08e36e/users/c7f7b8a0340946a3a2ba6479edaf3300/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:01.863752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb8c4-edff-4362-820e-c0d53dcca7be admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.933946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb977253-3e7f-4257-a2e1-11daeb26cc24 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.005911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deb8c4-edff-4362-820e-c0d53dcca7be admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.011559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d9729-35f0-480d-88f8-958664a1b16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.012516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d9729-35f0-480d-88f8-958664a1b16f admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.012893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d9729-35f0-480d-88f8-958664a1b16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.013263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d9729-35f0-480d-88f8-958664a1b16f admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.014025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d9729-35f0-480d-88f8-958664a1b16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.015775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d9729-35f0-480d-88f8-958664a1b16f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.016361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.019454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.019454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.019454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.020050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:02.030273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.031450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1037/2080] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:02.032003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.032327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d9729-35f0-480d-88f8-958664a1b16f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.044646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1044/2081] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:02.044963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.046441 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.049052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d9729-35f0-480d-88f8-958664a1b16f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.054473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9af27a-7a98-47b7-8b6c-691c0d209ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.055100 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af27a-7a98-47b7-8b6c-691c0d209ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.055693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af27a-7a98-47b7-8b6c-691c0d209ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.055978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af27a-7a98-47b7-8b6c-691c0d209ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.057238 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9af27a-7a98-47b7-8b6c-691c0d209ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.059495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9af27a-7a98-47b7-8b6c-691c0d209ac3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.061115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9655-a71a-4462-a614-ef76144c6492 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.071196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1038/2082] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:02.072519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9af27a-7a98-47b7-8b6c-691c0d209ac3 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.075069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.075430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.076518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.077044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] PATH_INFO: `/v3/projects/1148b05103a144ae868c885903f06f6f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.082998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1148b05103a144ae868c885903f06f6f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.085623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.086294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9af27a-7a98-47b7-8b6c-691c0d209ac3 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.093494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c67e00-7c52-44aa-988d-877208318e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.094222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c67e00-7c52-44aa-988d-877208318e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.094672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c67e00-7c52-44aa-988d-877208318e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.095067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c67e00-7c52-44aa-988d-877208318e1a admin admin] PATH_INFO: `/v3/projects/a306f1ec7c75481ea6779d9839fda254/users/35ea6dfd74c143e2b15d2824fa952004/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.115646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c67e00-7c52-44aa-988d-877208318e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a306f1ec7c75481ea6779d9839fda254, user_id=35ea6dfd74c143e2b15d2824fa952004, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.118572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c67e00-7c52-44aa-988d-877208318e1a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.137415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1039/2083] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:02 2022] PUT /identity/v3/projects/a306f1ec7c75481ea6779d9839fda254/users/35ea6dfd74c143e2b15d2824fa952004/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:02.139578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c67e00-7c52-44aa-988d-877208318e1a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.173445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1148b05103a144ae868c885903f06f6f', 'request_id': 'req-aa880904-1dcf-4f49-8eaa-4035e2c95768'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.175481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:02.184241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1148b05103a144ae868c885903f06f6f', 'request_id': 'req-aa880904-1dcf-4f49-8eaa-4035e2c95768'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.192449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1148b05103a144ae868c885903f06f6f', 'request_id': 'req-aa880904-1dcf-4f49-8eaa-4035e2c95768'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.211192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] The token cache is being invalidate because project 1148b05103a144ae868c885903f06f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:02.211501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.212167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa880904-1dcf-4f49-8eaa-4035e2c95768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.214446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1045/2084] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:02 2022] DELETE /identity/v3/projects/1148b05103a144ae868c885903f06f6f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:02.215551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724327-8877-43c3-9ef6-9a55689f9797 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.215837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724327-8877-43c3-9ef6-9a55689f9797 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.216109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724327-8877-43c3-9ef6-9a55689f9797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.242554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c67e00-7c52-44aa-988d-877208318e1a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.251355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7d724327-8877-43c3-9ef6-9a55689f9797 None None] MFA Rules not processed for user `35ea6dfd74c143e2b15d2824fa952004`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:02.251355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7d724327-8877-43c3-9ef6-9a55689f9797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.335154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.337252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.339200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.339873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] PATH_INFO: `/v3/projects/37e581e2dacb44e298e366e44a08e36e/users/c7f7b8a0340946a3a2ba6479edaf3300/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.342700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1046/2085] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:02.344050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d5258-c4cb-4323-95d0-b98a891ea8c0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.344345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d5258-c4cb-4323-95d0-b98a891ea8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.344627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d5258-c4cb-4323-95d0-b98a891ea8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.345209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e581e2dacb44e298e366e44a08e36e, user_id=c7f7b8a0340946a3a2ba6479edaf3300, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.352885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.380257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-977d5258-c4cb-4323-95d0-b98a891ea8c0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:02.380257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-977d5258-c4cb-4323-95d0-b98a891ea8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.380471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1040/2086] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:02 2022] PUT /identity/v3/projects/37e581e2dacb44e298e366e44a08e36e/users/c7f7b8a0340946a3a2ba6479edaf3300/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:02.380471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.389383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.457677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1047/2087] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:02.457677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9c3d-1c92-4b3b-becf-503f6bd9a71d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.457677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9c3d-1c92-4b3b-becf-503f6bd9a71d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.457677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9c3d-1c92-4b3b-becf-503f6bd9a71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.485220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9f7a9c3d-1c92-4b3b-becf-503f6bd9a71d None None] MFA Rules not processed for user `c7f7b8a0340946a3a2ba6479edaf3300`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:02.486650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f7a9c3d-1c92-4b3b-becf-503f6bd9a71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.498137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639410e-0f97-412c-924e-ea58b4d8a7a8 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.505304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.506232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.506626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.507232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.508488 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.510999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.526852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:02.548891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1041/2088] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:02 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:02.549756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.552433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.575972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:02.599361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1048/2089] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:02.600979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91141b-d637-448c-b1ca-6bc8237b922f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.601215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91141b-d637-448c-b1ca-6bc8237b922f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.601476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91141b-d637-448c-b1ca-6bc8237b922f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.623226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ee91141b-d637-448c-b1ca-6bc8237b922f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:02.624664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee91141b-d637-448c-b1ca-6bc8237b922f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.651747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72887715-1b3f-4e76-95d0-5df22ef55865 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.663727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.664525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.664877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.665220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] PATH_INFO: `/v3/projects/8290761e8387437195fd23557f630b5e` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.666499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8290761e8387437195fd23557f630b5e)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.669483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.688696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1049/2090] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:02.689544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91141b-d637-448c-b1ca-6bc8237b922f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.699239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91141b-d637-448c-b1ca-6bc8237b922f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.703989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.704635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.704878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.705144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.705931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.707941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.726327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8290761e8387437195fd23557f630b5e', 'request_id': 'req-d635a767-6980-4f50-9402-070545f437ad'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.732697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8290761e8387437195fd23557f630b5e', 'request_id': 'req-d635a767-6980-4f50-9402-070545f437ad'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.736709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1050/2091] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:02 2022] POST /identity/v3/users => generated 300 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:02.736709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.738222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.741736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8290761e8387437195fd23557f630b5e', 'request_id': 'req-d635a767-6980-4f50-9402-070545f437ad'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.753954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] The token cache is being invalidate because project 8290761e8387437195fd23557f630b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:02.754274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.754936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.756463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1042/2092] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:02 2022] DELETE /identity/v3/projects/8290761e8387437195fd23557f630b5e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:02.757226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.758573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.799764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6de11-38e9-4320-b1ad-56ba88944504 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.825462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635a767-6980-4f50-9402-070545f437ad admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.830869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.833435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.833435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.833435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.833435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:02.833435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.834621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.851735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1043/2093] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:02.851735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.851735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.858145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.858786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.859065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.859335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.861134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.865166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5884d4-4fb9-4526-9aa8-be346641ff45 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.871079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.871697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.871986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.872259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.872970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.874729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.885726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1044/2094] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:02.886564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.888994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.897386 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:02.903722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb4e78-6a4f-4de9-a35a-5ca9a108d31c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.910237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.910949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.911302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.911646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] PATH_INFO: `/v3/users/5f6794498fcc4f89b6e4a2782f4a578f` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.912894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6794498fcc4f89b6e4a2782f4a578f)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.915227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.922606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:02.937912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.939378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.949447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1051/2095] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:02.950239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.961286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6826-a156-430e-9843-7a38f77dc953 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.966115 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.967468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.967754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.968033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.968693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.970519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6794498fcc4f89b6e4a2782f4a578f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.970633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:02.974465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6794498fcc4f89b6e4a2782f4a578f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.990333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6794498fcc4f89b6e4a2782f4a578f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.000569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6794498fcc4f89b6e4a2782f4a578f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.001349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6794498fcc4f89b6e4a2782f4a578f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.005926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1052/2096] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:02 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:03.007010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.016072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.020969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1045/2097] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:02 2022] DELETE /identity/v3/users/5f6794498fcc4f89b6e4a2782f4a578f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:03.021672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.023131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.120402 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab1d9c-216b-4311-86f0-41560dcc400e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.140505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f990e0a-5dca-465a-a7fd-71e0958d645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.143042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990e0a-5dca-465a-a7fd-71e0958d645b admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.143042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990e0a-5dca-465a-a7fd-71e0958d645b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.143256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f990e0a-5dca-465a-a7fd-71e0958d645b admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.145271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f990e0a-5dca-465a-a7fd-71e0958d645b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.157119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f990e0a-5dca-465a-a7fd-71e0958d645b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.193293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2e844-1c02-4ff7-b459-dae962b349e8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.199898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1046/2098] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/users => generated 304 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:03.203929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f990e0a-5dca-465a-a7fd-71e0958d645b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.210214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda586db-d7d5-4aec-bf6d-75d7e9192404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.211314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda586db-d7d5-4aec-bf6d-75d7e9192404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.211954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda586db-d7d5-4aec-bf6d-75d7e9192404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.212220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda586db-d7d5-4aec-bf6d-75d7e9192404 admin admin] PATH_INFO: `/v3/projects/f2897977ddb6437ab633e9a52af3063c/users/78184d467bec4b55a1362e8beaedb48e/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.225558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f990e0a-5dca-465a-a7fd-71e0958d645b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.237356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498163f-892e-4038-8da5-7457296c52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.238031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498163f-892e-4038-8da5-7457296c52d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.238317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498163f-892e-4038-8da5-7457296c52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.238625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498163f-892e-4038-8da5-7457296c52d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.239404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498163f-892e-4038-8da5-7457296c52d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.242336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498163f-892e-4038-8da5-7457296c52d3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.257870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda586db-d7d5-4aec-bf6d-75d7e9192404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2897977ddb6437ab633e9a52af3063c, user_id=78184d467bec4b55a1362e8beaedb48e, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.259749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1047/2099] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:03.264086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498163f-892e-4038-8da5-7457296c52d3 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.264489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda586db-d7d5-4aec-bf6d-75d7e9192404 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.292969 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1053/2100] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:03 2022] PUT /identity/v3/projects/f2897977ddb6437ab633e9a52af3063c/users/78184d467bec4b55a1362e8beaedb48e/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:03.298181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda586db-d7d5-4aec-bf6d-75d7e9192404 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.303071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498163f-892e-4038-8da5-7457296c52d3 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.424461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda586db-d7d5-4aec-bf6d-75d7e9192404 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.451453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c41709-17c4-43ba-9184-804309a6d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.453989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41709-17c4-43ba-9184-804309a6d4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.454487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41709-17c4-43ba-9184-804309a6d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.454950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41709-17c4-43ba-9184-804309a6d4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.456129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c41709-17c4-43ba-9184-804309a6d4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.460773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c41709-17c4-43ba-9184-804309a6d4a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.477568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1054/2101] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:03.478729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c41709-17c4-43ba-9184-804309a6d4a0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.480196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:03.494374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c41709-17c4-43ba-9184-804309a6d4a0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.506232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1917e7d-db9f-4585-b86a-5def7a19539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.507074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1917e7d-db9f-4585-b86a-5def7a19539f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.507464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1917e7d-db9f-4585-b86a-5def7a19539f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.508005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1917e7d-db9f-4585-b86a-5def7a19539f admin admin] PATH_INFO: `/v3/projects/f2897977ddb6437ab633e9a52af3063c/users/78184d467bec4b55a1362e8beaedb48e/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.512751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1917e7d-db9f-4585-b86a-5def7a19539f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2897977ddb6437ab633e9a52af3063c, user_id=78184d467bec4b55a1362e8beaedb48e, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.513218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf437cc8-c777-44a4-837b-64282e3e59fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.513915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437cc8-c777-44a4-837b-64282e3e59fb admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.514203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437cc8-c777-44a4-837b-64282e3e59fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.514479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437cc8-c777-44a4-837b-64282e3e59fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.515128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437cc8-c777-44a4-837b-64282e3e59fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.516507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1917e7d-db9f-4585-b86a-5def7a19539f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.522013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437cc8-c777-44a4-837b-64282e3e59fb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.546927 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1055/2102] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:03 2022] PUT /identity/v3/projects/f2897977ddb6437ab633e9a52af3063c/users/78184d467bec4b55a1362e8beaedb48e/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:03.553870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1048/2103] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:03.554957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1917e7d-db9f-4585-b86a-5def7a19539f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.556967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda18db-2d7c-4932-b8ff-77110e8ec157 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.557266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda18db-2d7c-4932-b8ff-77110e8ec157 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.558297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda18db-2d7c-4932-b8ff-77110e8ec157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.650844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4fda18db-2d7c-4932-b8ff-77110e8ec157 None None] MFA Rules not processed for user `78184d467bec4b55a1362e8beaedb48e`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:03.654460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4fda18db-2d7c-4932-b8ff-77110e8ec157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.664942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:03.720359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1917e7d-db9f-4585-b86a-5def7a19539f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.726007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.726675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.727146 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.727294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] PATH_INFO: `/v3/projects/f85c2e4e4e8e4475955441149e7769ab/users/e556ad9f07974ec78881000d33d1eaa1/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.744082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85c2e4e4e8e4475955441149e7769ab, user_id=e556ad9f07974ec78881000d33d1eaa1, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.746895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.762154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1056/2104] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:03 2022] PUT /identity/v3/projects/f85c2e4e4e8e4475955441149e7769ab/users/e556ad9f07974ec78881000d33d1eaa1/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:03.762973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.772869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.774699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1049/2105] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:03.776102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2716-fcf6-461b-bd62-5dcff2bec5c2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.776464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2716-fcf6-461b-bd62-5dcff2bec5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.776738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc2716-fcf6-461b-bd62-5dcff2bec5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.811667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-5bcc2716-fcf6-461b-bd62-5dcff2bec5c2 None None] MFA Rules not processed for user `e556ad9f07974ec78881000d33d1eaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:03.813298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5bcc2716-fcf6-461b-bd62-5dcff2bec5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.858055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7bba6-c7de-44ec-ac81-24777ec588ea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.863597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.864233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.864514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.864787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] PATH_INFO: `/v3/projects/e7618cb752f04b1199c386d8a1ce8407` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.866301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7618cb752f04b1199c386d8a1ce8407)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.868640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.888848 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1050/2106] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:03.889826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc2716-fcf6-461b-bd62-5dcff2bec5c2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.893629 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5bcc2716-fcf6-461b-bd62-5dcff2bec5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.922123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7618cb752f04b1199c386d8a1ce8407', 'request_id': 'req-62134317-b198-4535-b483-8d392eb68436'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.932931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7618cb752f04b1199c386d8a1ce8407', 'request_id': 'req-62134317-b198-4535-b483-8d392eb68436'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.942666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7618cb752f04b1199c386d8a1ce8407', 'request_id': 'req-62134317-b198-4535-b483-8d392eb68436'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.955507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] The token cache is being invalidate because project e7618cb752f04b1199c386d8a1ce8407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:03.955929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.956654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.958510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1057/2107] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:03 2022] DELETE /identity/v3/projects/e7618cb752f04b1199c386d8a1ce8407 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:03.959363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.963677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.969048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc2716-fcf6-461b-bd62-5dcff2bec5c2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.987229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:04.017418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:04.022863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.024004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.024451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.024795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.027485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.039917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134317-b198-4535-b483-8d392eb68436 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.045034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe471d41-cceb-45b5-b287-dc9cbbe02ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.045820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe471d41-cceb-45b5-b287-dc9cbbe02ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.046219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe471d41-cceb-45b5-b287-dc9cbbe02ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.049476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe471d41-cceb-45b5-b287-dc9cbbe02ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.049476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe471d41-cceb-45b5-b287-dc9cbbe02ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.049476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe471d41-cceb-45b5-b287-dc9cbbe02ed5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.085732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1058/2108] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:04.085732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee74e7c-5a86-4e17-932f-3edecc8468a4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.085732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee74e7c-5a86-4e17-932f-3edecc8468a4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.085732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee74e7c-5a86-4e17-932f-3edecc8468a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.101820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.103488 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.106619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0ee74e7c-5a86-4e17-932f-3edecc8468a4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:04.108261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ee74e7c-5a86-4e17-932f-3edecc8468a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.114753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1051/2109] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:04.115913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.133418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710721-ec79-4439-8aec-7ca11bfcb1f1 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.204634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1059/2110] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:04.212162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee74e7c-5a86-4e17-932f-3edecc8468a4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.212731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f70c8f-0234-48ae-9bf7-c1efc7e9d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.212731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f70c8f-0234-48ae-9bf7-c1efc7e9d478 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.212731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f70c8f-0234-48ae-9bf7-c1efc7e9d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.213020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ee74e7c-5a86-4e17-932f-3edecc8468a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.213094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f70c8f-0234-48ae-9bf7-c1efc7e9d478 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.213094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f70c8f-0234-48ae-9bf7-c1efc7e9d478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.213094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f70c8f-0234-48ae-9bf7-c1efc7e9d478 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.221016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee74e7c-5a86-4e17-932f-3edecc8468a4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.226010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.226674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.227046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.227383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] PATH_INFO: `/v3/users/35ea6dfd74c143e2b15d2824fa952004` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.228645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ea6dfd74c143e2b15d2824fa952004)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.230665 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.240252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1052/2111] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:04 2022] POST /identity/v3/users => generated 309 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:04.242119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2cb7-a20c-48cc-84e2-5c8cb2aac3e7 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.242631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2cb7-a20c-48cc-84e2-5c8cb2aac3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.243197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2cb7-a20c-48cc-84e2-5c8cb2aac3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.267048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-1cfe2cb7-a20c-48cc-84e2-5c8cb2aac3e7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:04.268468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1cfe2cb7-a20c-48cc-84e2-5c8cb2aac3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.278674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1053/2112] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:04.280235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe2cb7-a20c-48cc-84e2-5c8cb2aac3e7 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.290799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe2cb7-a20c-48cc-84e2-5c8cb2aac3e7 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.295829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.296458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.296743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.297022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.297684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.299370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.301095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ea6dfd74c143e2b15d2824fa952004'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.302020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ea6dfd74c143e2b15d2824fa952004'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.310775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1054/2113] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:04.311904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.313679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.325087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ea6dfd74c143e2b15d2824fa952004'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.330925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31556b78-b22e-45bf-8d7f-c16902b4644c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.334978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ea6dfd74c143e2b15d2824fa952004'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.335709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ea6dfd74c143e2b15d2824fa952004'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.336443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f461995-76ae-4c77-9cfb-d38e54396bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.337126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461995-76ae-4c77-9cfb-d38e54396bad admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.337352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461995-76ae-4c77-9cfb-d38e54396bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.337615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461995-76ae-4c77-9cfb-d38e54396bad admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.338564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f461995-76ae-4c77-9cfb-d38e54396bad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:04.338689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f461995-76ae-4c77-9cfb-d38e54396bad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.340319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f461995-76ae-4c77-9cfb-d38e54396bad admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.350784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1060/2114] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:04 2022] DELETE /identity/v3/users/35ea6dfd74c143e2b15d2824fa952004 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:04.354027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1055/2115] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:04.354612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.355611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546a42-66d2-4dc7-a3f1-d488e7ad9537 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.355897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546a42-66d2-4dc7-a3f1-d488e7ad9537 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.356173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8546a42-66d2-4dc7-a3f1-d488e7ad9537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.359817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.378689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-f8546a42-66d2-4dc7-a3f1-d488e7ad9537 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:04.379919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f8546a42-66d2-4dc7-a3f1-d488e7ad9537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.405678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:04.412404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:04.434633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d944ee8-35ec-41ee-9966-f11904c47d39 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.440357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.441065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.441878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.441878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] PATH_INFO: `/v3/projects/be3aee92f4974126aa3ef273055cb4d1/users/f00e283ab1f54c808daa21d2a2586443/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.450503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1056/2116] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:04.452047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8546a42-66d2-4dc7-a3f1-d488e7ad9537 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.462109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3aee92f4974126aa3ef273055cb4d1, user_id=f00e283ab1f54c808daa21d2a2586443, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.465062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.470747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8546a42-66d2-4dc7-a3f1-d488e7ad9537 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.476297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746c19-179c-49bd-8880-1d1c8b87c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.476974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746c19-179c-49bd-8880-1d1c8b87c36d admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.477227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746c19-179c-49bd-8880-1d1c8b87c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.477646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a746c19-179c-49bd-8880-1d1c8b87c36d admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.478324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746c19-179c-49bd-8880-1d1c8b87c36d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.480279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a746c19-179c-49bd-8880-1d1c8b87c36d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.483322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1061/2117] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:04 2022] PUT /identity/v3/projects/be3aee92f4974126aa3ef273055cb4d1/users/f00e283ab1f54c808daa21d2a2586443/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:04.484280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.487596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.517565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1057/2118] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:04 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:04.518692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746c19-179c-49bd-8880-1d1c8b87c36d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.559094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c44ee7-dcce-44b0-bf43-d6f995f6554b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.634931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a746c19-179c-49bd-8880-1d1c8b87c36d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.637379 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f031f-f884-443b-a0bb-e47ea74e5706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.642225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005261-77e7-4b0f-8a4c-f9f2650c47b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.642879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005261-77e7-4b0f-8a4c-f9f2650c47b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.643113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005261-77e7-4b0f-8a4c-f9f2650c47b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.643389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005261-77e7-4b0f-8a4c-f9f2650c47b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.644042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d005261-77e7-4b0f-8a4c-f9f2650c47b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.645920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d005261-77e7-4b0f-8a4c-f9f2650c47b3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.657005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f031f-f884-443b-a0bb-e47ea74e5706 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.657005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f031f-f884-443b-a0bb-e47ea74e5706 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.657005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f031f-f884-443b-a0bb-e47ea74e5706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.663551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1058/2119] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:04.664461 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005261-77e7-4b0f-8a4c-f9f2650c47b3 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.668174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f031f-f884-443b-a0bb-e47ea74e5706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.670091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f031f-f884-443b-a0bb-e47ea74e5706 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.679296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005261-77e7-4b0f-8a4c-f9f2650c47b3 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.684349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf5ea2-7e86-400b-8160-6a1d0aa4c8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.684963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf5ea2-7e86-400b-8160-6a1d0aa4c8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.686012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf5ea2-7e86-400b-8160-6a1d0aa4c8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.686342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf5ea2-7e86-400b-8160-6a1d0aa4c8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.687110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf5ea2-7e86-400b-8160-6a1d0aa4c8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.690538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf5ea2-7e86-400b-8160-6a1d0aa4c8b3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.694865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1062/2120] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:04.695837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f031f-f884-443b-a0bb-e47ea74e5706 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.722031 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f031f-f884-443b-a0bb-e47ea74e5706 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.724788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1059/2121] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:04 2022] POST /identity/v3/users => generated 290 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:04.730788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf5ea2-7e86-400b-8160-6a1d0aa4c8b3 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.731436 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4d4b6-f193-46df-9c77-adee22a5097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.738081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d4b6-f193-46df-9c77-adee22a5097c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.738367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d4b6-f193-46df-9c77-adee22a5097c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.738647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4d4b6-f193-46df-9c77-adee22a5097c admin admin] PATH_INFO: `/v3/projects/be3aee92f4974126aa3ef273055cb4d1/users/f00e283ab1f54c808daa21d2a2586443/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.748977 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4d4b6-f193-46df-9c77-adee22a5097c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3aee92f4974126aa3ef273055cb4d1, user_id=f00e283ab1f54c808daa21d2a2586443, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.754101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4d4b6-f193-46df-9c77-adee22a5097c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.758955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf5ea2-7e86-400b-8160-6a1d0aa4c8b3 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.773213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753062f-0fd0-41a2-9a5b-47a7dc42813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.776313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753062f-0fd0-41a2-9a5b-47a7dc42813f admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.776313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753062f-0fd0-41a2-9a5b-47a7dc42813f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.776573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753062f-0fd0-41a2-9a5b-47a7dc42813f admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.777791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753062f-0fd0-41a2-9a5b-47a7dc42813f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.781284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753062f-0fd0-41a2-9a5b-47a7dc42813f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.794230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1063/2122] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:04 2022] PUT /identity/v3/projects/be3aee92f4974126aa3ef273055cb4d1/users/f00e283ab1f54c808daa21d2a2586443/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:04.801701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893f92-8bd4-402a-932f-41f5f3c2122e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.802232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893f92-8bd4-402a-932f-41f5f3c2122e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.802528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893f92-8bd4-402a-932f-41f5f3c2122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.820037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1060/2123] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:04.821587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753062f-0fd0-41a2-9a5b-47a7dc42813f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.836212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753062f-0fd0-41a2-9a5b-47a7dc42813f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.881311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-22893f92-8bd4-402a-932f-41f5f3c2122e None None] MFA Rules not processed for user `f00e283ab1f54c808daa21d2a2586443`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:04.883560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-22893f92-8bd4-402a-932f-41f5f3c2122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.936863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f81e-fcf0-4cf9-b455-2f464e64bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.937531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f81e-fcf0-4cf9-b455-2f464e64bfbe admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.937819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f81e-fcf0-4cf9-b455-2f464e64bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.938123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8f81e-fcf0-4cf9-b455-2f464e64bfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.939304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f81e-fcf0-4cf9-b455-2f464e64bfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.941999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8f81e-fcf0-4cf9-b455-2f464e64bfbe admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.958771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1061/2124] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:04.959701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f81e-fcf0-4cf9-b455-2f464e64bfbe admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.974665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8f81e-fcf0-4cf9-b455-2f464e64bfbe admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.983092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c52ddd-f9b6-4ea3-b82a-36bc6289c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.983773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c52ddd-f9b6-4ea3-b82a-36bc6289c95f admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.984343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c52ddd-f9b6-4ea3-b82a-36bc6289c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.984688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c52ddd-f9b6-4ea3-b82a-36bc6289c95f admin admin] PATH_INFO: `/v3/projects/8c177ea1fa7d4d309f9d9efc0ad198e2/users/10b9feea680648cab3c95e06265de049/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.005198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:05.021164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c52ddd-f9b6-4ea3-b82a-36bc6289c95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c177ea1fa7d4d309f9d9efc0ad198e2, user_id=10b9feea680648cab3c95e06265de049, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:05.027271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c52ddd-f9b6-4ea3-b82a-36bc6289c95f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:05.070325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1062/2125] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:04 2022] PUT /identity/v3/projects/8c177ea1fa7d4d309f9d9efc0ad198e2/users/10b9feea680648cab3c95e06265de049/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:05.073568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be40e3b-28c2-452d-be18-dddfe0db8f79 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.074543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be40e3b-28c2-452d-be18-dddfe0db8f79 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.075472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be40e3b-28c2-452d-be18-dddfe0db8f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.098043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:05.118302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1064/2126] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:05.148934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893f92-8bd4-402a-932f-41f5f3c2122e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:05.150417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-22893f92-8bd4-402a-932f-41f5f3c2122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:05.160813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-6be40e3b-28c2-452d-be18-dddfe0db8f79 None None] MFA Rules not processed for user `10b9feea680648cab3c95e06265de049`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:05.162390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6be40e3b-28c2-452d-be18-dddfe0db8f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:05.235903 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893f92-8bd4-402a-932f-41f5f3c2122e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:05.334147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7bc6-f311-4892-8fe1-44e19cc87df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:05.334654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1063/2127] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:05.335591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7bc6-f311-4892-8fe1-44e19cc87df2 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.335821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be40e3b-28c2-452d-be18-dddfe0db8f79 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:05.336177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7bc6-f311-4892-8fe1-44e19cc87df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.336605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7bc6-f311-4892-8fe1-44e19cc87df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.346894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6be40e3b-28c2-452d-be18-dddfe0db8f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:05.442130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be40e3b-28c2-452d-be18-dddfe0db8f79 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:05.447905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:05.448889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.449249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.450041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] PATH_INFO: `/v3/projects/a306f1ec7c75481ea6779d9839fda254` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.451557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a306f1ec7c75481ea6779d9839fda254)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:05.453985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7bc6-f311-4892-8fe1-44e19cc87df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:05.454715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:05.455622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7bc6-f311-4892-8fe1-44e19cc87df2 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:05.467527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1065/2128] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:05 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:05.468539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7bc6-f311-4892-8fe1-44e19cc87df2 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:05.484602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7bc6-f311-4892-8fe1-44e19cc87df2 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:05.494467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a443a-9fe2-401d-8b55-00da1c2cce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:05.495214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a443a-9fe2-401d-8b55-00da1c2cce3c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.495503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a443a-9fe2-401d-8b55-00da1c2cce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.495812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a443a-9fe2-401d-8b55-00da1c2cce3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.496446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a443a-9fe2-401d-8b55-00da1c2cce3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:05.499829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a443a-9fe2-401d-8b55-00da1c2cce3c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:05.526225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a306f1ec7c75481ea6779d9839fda254', 'request_id': 'req-5c0224dd-8858-41ac-85ea-96d90f8b670c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.533393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a306f1ec7c75481ea6779d9839fda254', 'request_id': 'req-5c0224dd-8858-41ac-85ea-96d90f8b670c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.543890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a306f1ec7c75481ea6779d9839fda254', 'request_id': 'req-5c0224dd-8858-41ac-85ea-96d90f8b670c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.549874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1066/2129] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:05 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:05.554274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a443a-9fe2-401d-8b55-00da1c2cce3c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:05.557746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] The token cache is being invalidate because project a306f1ec7c75481ea6779d9839fda254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:05.558158 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.558986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.561124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1064/2130] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:05 2022] DELETE /identity/v3/projects/a306f1ec7c75481ea6779d9839fda254 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:05.565440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:05.568027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:05.583169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:05.642017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:05.684671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0224dd-8858-41ac-85ea-96d90f8b670c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:05.700366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:05.701692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.701857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.702368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] PATH_INFO: `/v3/users/78184d467bec4b55a1362e8beaedb48e` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.703704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a443a-9fe2-401d-8b55-00da1c2cce3c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:05.718805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] RBAC: Authorizing `identity:delete_user(user_id=78184d467bec4b55a1362e8beaedb48e)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:05.718805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:05.720197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:05.720841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.721127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.721406 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.722325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:05.725571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:05.756259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1067/2131] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:05 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:05.757277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:05.759084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:05.787003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78184d467bec4b55a1362e8beaedb48e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.787832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78184d467bec4b55a1362e8beaedb48e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.803345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78184d467bec4b55a1362e8beaedb48e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.818777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78184d467bec4b55a1362e8beaedb48e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.820180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78184d467bec4b55a1362e8beaedb48e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.850255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1065/2132] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:05 2022] DELETE /identity/v3/users/78184d467bec4b55a1362e8beaedb48e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:05.851350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:05.854537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:05.869717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376c894-b38f-4e9f-a7ec-ab5f1fa36977 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:05.978826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:05.981630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.982284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.982635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.986884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.017050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7f058-cf12-4878-aebb-4925088523df admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.031336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca3500-4d08-4926-8728-5301ba52f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.031917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca3500-4d08-4926-8728-5301ba52f446 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.032806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca3500-4d08-4926-8728-5301ba52f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.034239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca3500-4d08-4926-8728-5301ba52f446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.035688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca3500-4d08-4926-8728-5301ba52f446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.038112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca3500-4d08-4926-8728-5301ba52f446 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.056937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1066/2133] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:06.070237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca3500-4d08-4926-8728-5301ba52f446 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.088615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca3500-4d08-4926-8728-5301ba52f446 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.100932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ee506-2148-41bc-8f48-4498572c8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.102058 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ee506-2148-41bc-8f48-4498572c8aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.102581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ee506-2148-41bc-8f48-4498572c8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.103483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ee506-2148-41bc-8f48-4498572c8aec admin admin] PATH_INFO: `/v3/projects/18cc1b0990654ad7879df1b98e17a050/users/5db8a690792d4ea69bf9b0b273e364a8/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.145026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ee506-2148-41bc-8f48-4498572c8aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cc1b0990654ad7879df1b98e17a050, user_id=5db8a690792d4ea69bf9b0b273e364a8, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.147924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ee506-2148-41bc-8f48-4498572c8aec admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.158544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:06.163293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.166750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1067/2134] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:06 2022] PUT /identity/v3/projects/18cc1b0990654ad7879df1b98e17a050/users/5db8a690792d4ea69bf9b0b273e364a8/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:06.168122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.170928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ee506-2148-41bc-8f48-4498572c8aec admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.194823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1068/2135] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:05 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:06.321030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ee506-2148-41bc-8f48-4498572c8aec admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.339523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fec1a1-a1f5-4706-b9fa-d2d8f3c39c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.340293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fec1a1-a1f5-4706-b9fa-d2d8f3c39c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.340578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fec1a1-a1f5-4706-b9fa-d2d8f3c39c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.340851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fec1a1-a1f5-4706-b9fa-d2d8f3c39c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.342077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fec1a1-a1f5-4706-b9fa-d2d8f3c39c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.344962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fec1a1-a1f5-4706-b9fa-d2d8f3c39c38 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.374741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1068/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:06.376271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.389394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc3086-2221-416f-a2d9-f6ef22f6026e service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.395470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.396765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.397408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.397939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] PATH_INFO: `/v3/projects/18cc1b0990654ad7879df1b98e17a050/users/5db8a690792d4ea69bf9b0b273e364a8/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.401524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cc1b0990654ad7879df1b98e17a050, user_id=5db8a690792d4ea69bf9b0b273e364a8, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.407950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.429485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1069/2137] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:06 2022] PUT /identity/v3/projects/18cc1b0990654ad7879df1b98e17a050/users/5db8a690792d4ea69bf9b0b273e364a8/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:06.443026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748b22a-00b1-4038-9ac0-0d65e17731da None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.443534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748b22a-00b1-4038-9ac0-0d65e17731da None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.444655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748b22a-00b1-4038-9ac0-0d65e17731da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.450097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.454468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.515815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:06.541889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-7748b22a-00b1-4038-9ac0-0d65e17731da None None] MFA Rules not processed for user `5db8a690792d4ea69bf9b0b273e364a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:06.543706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7748b22a-00b1-4038-9ac0-0d65e17731da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.570389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa817e9-f09a-479d-9b02-5deb66b31043 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.584868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.585429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.585605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.586034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] PATH_INFO: `/v3/projects/f2897977ddb6437ab633e9a52af3063c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.587487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2897977ddb6437ab633e9a52af3063c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.590070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.662781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2897977ddb6437ab633e9a52af3063c', 'request_id': 'req-236309aa-e95a-4e95-8e46-b0ddb7b321ea'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:06.678343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2897977ddb6437ab633e9a52af3063c', 'request_id': 'req-236309aa-e95a-4e95-8e46-b0ddb7b321ea'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:06.686136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2897977ddb6437ab633e9a52af3063c', 'request_id': 'req-236309aa-e95a-4e95-8e46-b0ddb7b321ea'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:06.690484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1069/2138] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:06.704286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] The token cache is being invalidate because project f2897977ddb6437ab633e9a52af3063c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:06.705144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:06.706191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:06.708631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1070/2139] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:06 2022] DELETE /identity/v3/projects/f2897977ddb6437ab633e9a52af3063c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:06.713595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbb2e0-e894-48a3-9ea5-21951978126c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.713929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbb2e0-e894-48a3-9ea5-21951978126c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.714207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbb2e0-e894-48a3-9ea5-21951978126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.764080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-71dbb2e0-e894-48a3-9ea5-21951978126c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:06.764080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-71dbb2e0-e894-48a3-9ea5-21951978126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.775860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.778645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.857964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236309aa-e95a-4e95-8e46-b0ddb7b321ea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.862671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.863367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.863821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.864099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.867039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.878420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1070/2140] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:06.887183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e8a5-76ef-4973-a178-bd17ed69af62 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.887543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e8a5-76ef-4973-a178-bd17ed69af62 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.887929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43e8a5-76ef-4973-a178-bd17ed69af62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.941833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-de43e8a5-76ef-4973-a178-bd17ed69af62 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:06.942838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-de43e8a5-76ef-4973-a178-bd17ed69af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.968857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1071/2141] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:06.970465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43e8a5-76ef-4973-a178-bd17ed69af62 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.986353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43e8a5-76ef-4973-a178-bd17ed69af62 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.992292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.993061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.993375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.993621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.994315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:06.994632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.996236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.006135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:07.008530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.010099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.017882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1072/2142] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:07.021151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.037394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1071/2143] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:07.052740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5a10f-cb7e-445c-83ab-15b3336af823 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.059500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240aa88-8e36-4a70-8fdd-6ea9e1aabb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.060193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240aa88-8e36-4a70-8fdd-6ea9e1aabb72 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.061041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240aa88-8e36-4a70-8fdd-6ea9e1aabb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.070686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240aa88-8e36-4a70-8fdd-6ea9e1aabb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.071539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240aa88-8e36-4a70-8fdd-6ea9e1aabb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.074798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240aa88-8e36-4a70-8fdd-6ea9e1aabb72 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.170915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1073/2144] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:07.171940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.188392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3304c05-eb07-4e21-91d9-a0675485202d service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.194930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:07.292647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8687b08-bd9c-4dc3-a4f0-8843d27af35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.293259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8687b08-bd9c-4dc3-a4f0-8843d27af35c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.293544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8687b08-bd9c-4dc3-a4f0-8843d27af35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.293816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8687b08-bd9c-4dc3-a4f0-8843d27af35c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.295290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8687b08-bd9c-4dc3-a4f0-8843d27af35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.297292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8687b08-bd9c-4dc3-a4f0-8843d27af35c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.326735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1072/2145] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:07.331206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240aa88-8e36-4a70-8fdd-6ea9e1aabb72 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.346612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240aa88-8e36-4a70-8fdd-6ea9e1aabb72 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.351455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b8e88-ac10-4cb6-a5ba-48abeb9526d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.352112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b8e88-ac10-4cb6-a5ba-48abeb9526d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.352397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b8e88-ac10-4cb6-a5ba-48abeb9526d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.352670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b8e88-ac10-4cb6-a5ba-48abeb9526d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.353352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b8e88-ac10-4cb6-a5ba-48abeb9526d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.355024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b8e88-ac10-4cb6-a5ba-48abeb9526d7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.368057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1074/2146] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:07.374397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8687b08-bd9c-4dc3-a4f0-8843d27af35c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.399127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8687b08-bd9c-4dc3-a4f0-8843d27af35c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.403666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637db557-1ef6-4c0c-b6e3-0709603b4331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.404995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db557-1ef6-4c0c-b6e3-0709603b4331 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.405279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db557-1ef6-4c0c-b6e3-0709603b4331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.405554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db557-1ef6-4c0c-b6e3-0709603b4331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.406261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637db557-1ef6-4c0c-b6e3-0709603b4331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.408663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637db557-1ef6-4c0c-b6e3-0709603b4331 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.424649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1073/2147] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:07.428429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b8e88-ac10-4cb6-a5ba-48abeb9526d7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.445067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b8e88-ac10-4cb6-a5ba-48abeb9526d7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.450871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.451921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.452412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.452939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] PATH_INFO: `/v3/projects/4d19d08a363d4e459dc3d2dd4d2307c6/users/77bf8cbb0e504ec98318ffd372027cc6/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.472872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d19d08a363d4e459dc3d2dd4d2307c6, user_id=77bf8cbb0e504ec98318ffd372027cc6, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.476899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.499968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1075/2148] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:07 2022] PUT /identity/v3/projects/4d19d08a363d4e459dc3d2dd4d2307c6/users/77bf8cbb0e504ec98318ffd372027cc6/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:07.508488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b0ce0-3094-448b-aa83-63713990f48b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.509573 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b0ce0-3094-448b-aa83-63713990f48b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.510029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b0ce0-3094-448b-aa83-63713990f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.549196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-745b0ce0-3094-448b-aa83-63713990f48b None None] MFA Rules not processed for user `77bf8cbb0e504ec98318ffd372027cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:07.550533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-745b0ce0-3094-448b-aa83-63713990f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:07.650711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.652899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:07.684366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1074/2149] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:07.686668 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b0ce0-3094-448b-aa83-63713990f48b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.761496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65927504-468b-4c01-bb94-1b6021d46871 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.769534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.770450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.770900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.771329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] PATH_INFO: `/v3/users/10b9feea680648cab3c95e06265de049` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.774106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b9feea680648cab3c95e06265de049)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.780501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b0ce0-3094-448b-aa83-63713990f48b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.781688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.788802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605410-a536-4b71-91cf-54b30c798f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.790466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605410-a536-4b71-91cf-54b30c798f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.791547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605410-a536-4b71-91cf-54b30c798f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.791829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f605410-a536-4b71-91cf-54b30c798f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.792861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f605410-a536-4b71-91cf-54b30c798f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.798070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f605410-a536-4b71-91cf-54b30c798f27 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.837611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:07.849476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1075/2150] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:07.852210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605410-a536-4b71-91cf-54b30c798f27 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.861624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b9feea680648cab3c95e06265de049'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:07.862404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b9feea680648cab3c95e06265de049'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:07.879181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b9feea680648cab3c95e06265de049'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:07.900109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b9feea680648cab3c95e06265de049'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:07.900860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1188c858-5657-41cf-b74b-7bbcab6631c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b9feea680648cab3c95e06265de049'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:07.918801 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1076/2151] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:07 2022] DELETE /identity/v3/users/10b9feea680648cab3c95e06265de049 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:07.925516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb737dd-802d-480d-a719-c85557d74329 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.925879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb737dd-802d-480d-a719-c85557d74329 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.926709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb737dd-802d-480d-a719-c85557d74329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.958479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ccb737dd-802d-480d-a719-c85557d74329 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:07.959930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ccb737dd-802d-480d-a719-c85557d74329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:07.963440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f605410-a536-4b71-91cf-54b30c798f27 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.988753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:08.055281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1077/2152] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:08.061638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.062294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.062576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.062852 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.063477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.065756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.067286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb737dd-802d-480d-a719-c85557d74329 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.069080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ccb737dd-802d-480d-a719-c85557d74329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:08.100113 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1076/2153] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:08.104047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.106561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:08.124264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7226-31e0-4183-81b0-bd352ecee3e2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.129571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983295d0-7742-42eb-a261-c1b78dad0e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.130461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983295d0-7742-42eb-a261-c1b78dad0e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.130933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983295d0-7742-42eb-a261-c1b78dad0e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.131313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983295d0-7742-42eb-a261-c1b78dad0e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.132288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983295d0-7742-42eb-a261-c1b78dad0e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.134028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983295d0-7742-42eb-a261-c1b78dad0e11 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.151595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1077/2154] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:08.152640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983295d0-7742-42eb-a261-c1b78dad0e11 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.165572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983295d0-7742-42eb-a261-c1b78dad0e11 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.172598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa68ce-96c3-4b67-9682-f4268d3722f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.173550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa68ce-96c3-4b67-9682-f4268d3722f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.174035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa68ce-96c3-4b67-9682-f4268d3722f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.174522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa68ce-96c3-4b67-9682-f4268d3722f5 admin admin] PATH_INFO: `/v3/projects/5dc7f6a7f7674dc995608669989fe2fe/users/21779d11d4b148fab7c92f49340da365/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.194185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa68ce-96c3-4b67-9682-f4268d3722f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc7f6a7f7674dc995608669989fe2fe, user_id=21779d11d4b148fab7c92f49340da365, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.197470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa68ce-96c3-4b67-9682-f4268d3722f5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.220984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1078/2155] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:08 2022] PUT /identity/v3/projects/5dc7f6a7f7674dc995608669989fe2fe/users/21779d11d4b148fab7c92f49340da365/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:08.226200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa68ce-96c3-4b67-9682-f4268d3722f5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.298313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb737dd-802d-480d-a719-c85557d74329 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.391091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f86d2-859c-40f4-b050-dd5f4912632e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.392791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f86d2-859c-40f4-b050-dd5f4912632e service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.393104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f86d2-859c-40f4-b050-dd5f4912632e service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.393498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f86d2-859c-40f4-b050-dd5f4912632e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.450133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa68ce-96c3-4b67-9682-f4268d3722f5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.461637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.462874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.463154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.463430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.464078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.465786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.468853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:08.483763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1079/2156] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:08.484900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.487280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:08.531244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f86d2-859c-40f4-b050-dd5f4912632e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.532778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f86d2-859c-40f4-b050-dd5f4912632e service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.555267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1078/2157] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:08.556199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f86d2-859c-40f4-b050-dd5f4912632e service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.573121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f86d2-859c-40f4-b050-dd5f4912632e service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.579943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d644-7d4c-4c3c-9f7c-b04fca440b33 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.581176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.582702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.584686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b6b59-b5c5-4404-8bd5-8d7eabbae35d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.585418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6b59-b5c5-4404-8bd5-8d7eabbae35d service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.585806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6b59-b5c5-4404-8bd5-8d7eabbae35d service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.586181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6b59-b5c5-4404-8bd5-8d7eabbae35d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.588935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.589220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] PATH_INFO: `/v3/projects/5dc7f6a7f7674dc995608669989fe2fe/users/21779d11d4b148fab7c92f49340da365/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.590884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b3b6b59-b5c5-4404-8bd5-8d7eabbae35d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:08.594676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc7f6a7f7674dc995608669989fe2fe, user_id=21779d11d4b148fab7c92f49340da365, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.597978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.640468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1079/2158] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:08 2022] PUT /identity/v3/projects/5dc7f6a7f7674dc995608669989fe2fe/users/21779d11d4b148fab7c92f49340da365/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:08.640468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.640468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:08.666400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:08.698036 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b6b59-b5c5-4404-8bd5-8d7eabbae35d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.699553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b6b59-b5c5-4404-8bd5-8d7eabbae35d service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.714485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1080/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:08.715803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5cfb-9541-49e1-baf9-86b6ae0dd217 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.716100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5cfb-9541-49e1-baf9-86b6ae0dd217 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.716923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc5cfb-9541-49e1-baf9-86b6ae0dd217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.741063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c10513-0432-4a4a-adfd-3cd5cf63aa56 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.749009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.749929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.750187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.750459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] PATH_INFO: `/v3/users/f6e294533c4d431f9cec66dddec33299` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.751738 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e294533c4d431f9cec66dddec33299)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.754912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.758323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5acc5cfb-9541-49e1-baf9-86b6ae0dd217 None None] MFA Rules not processed for user `21779d11d4b148fab7c92f49340da365`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:08.759781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5acc5cfb-9541-49e1-baf9-86b6ae0dd217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:08.827216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e294533c4d431f9cec66dddec33299'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:08.828309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e294533c4d431f9cec66dddec33299'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:08.850091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e294533c4d431f9cec66dddec33299'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:08.863112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e294533c4d431f9cec66dddec33299'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:08.863943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e294533c4d431f9cec66dddec33299'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:08.881829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1080/2160] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:08 2022] DELETE /identity/v3/users/f6e294533c4d431f9cec66dddec33299 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:08.894064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1081/2161] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:08.907268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.908833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.020368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab1cf6-dc81-4249-866b-6fcbf3142c0d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.035194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.038915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.039307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.042852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.043512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc5cfb-9541-49e1-baf9-86b6ae0dd217 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.045439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5acc5cfb-9541-49e1-baf9-86b6ae0dd217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.070660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc5cfb-9541-49e1-baf9-86b6ae0dd217 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.134722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:09.139340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:09.161886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.163584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.176038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1081/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:09.177166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.178641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.199565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.200340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.201281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.201636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] PATH_INFO: `/v3/projects/8c177ea1fa7d4d309f9d9efc0ad198e2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.203078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c177ea1fa7d4d309f9d9efc0ad198e2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.205307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.289577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c177ea1fa7d4d309f9d9efc0ad198e2', 'request_id': 'req-90b16518-f709-4477-8ff0-be99d5189b49'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.294224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb61c6-81f0-4e6c-a1ac-271e88f77bf2 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.318086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c177ea1fa7d4d309f9d9efc0ad198e2', 'request_id': 'req-90b16518-f709-4477-8ff0-be99d5189b49'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.327970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c177ea1fa7d4d309f9d9efc0ad198e2', 'request_id': 'req-90b16518-f709-4477-8ff0-be99d5189b49'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.355662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] The token cache is being invalidate because project 8c177ea1fa7d4d309f9d9efc0ad198e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:09.355957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.358417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.363982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1082/2163] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:09 2022] DELETE /identity/v3/projects/8c177ea1fa7d4d309f9d9efc0ad198e2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:09.368075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.370400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.389731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.391082 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.391360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.391926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] PATH_INFO: `/v3/projects/73db84cca15f4534a2e4ad6c9c0b1e92` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.392829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73db84cca15f4534a2e4ad6c9c0b1e92)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.394845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.448915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73db84cca15f4534a2e4ad6c9c0b1e92', 'request_id': 'req-c9613070-5376-48a1-9ed2-6bdac3728002'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.452627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16518-f709-4477-8ff0-be99d5189b49 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.454968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73db84cca15f4534a2e4ad6c9c0b1e92', 'request_id': 'req-c9613070-5376-48a1-9ed2-6bdac3728002'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.465327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73db84cca15f4534a2e4ad6c9c0b1e92', 'request_id': 'req-c9613070-5376-48a1-9ed2-6bdac3728002'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.480196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] The token cache is being invalidate because project 73db84cca15f4534a2e4ad6c9c0b1e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:09.480671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.481323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c9613070-5376-48a1-9ed2-6bdac3728002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.485589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1082/2164] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:09 2022] DELETE /identity/v3/projects/73db84cca15f4534a2e4ad6c9c0b1e92 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:09.490656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781b45-09b4-48fd-8cd3-27d5e933f5c4 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.490947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781b45-09b4-48fd-8cd3-27d5e933f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.491224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781b45-09b4-48fd-8cd3-27d5e933f5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.512261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-60781b45-09b4-48fd-8cd3-27d5e933f5c4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:09.513737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-60781b45-09b4-48fd-8cd3-27d5e933f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.516303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.516950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.517232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.517507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] PATH_INFO: `/v3/users/5db8a690792d4ea69bf9b0b273e364a8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.518687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db8a690792d4ea69bf9b0b273e364a8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.521325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.522882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1083/2165] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:09.532073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a8dc7-b874-4b63-b6d4-12506706cf75 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.532352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a8dc7-b874-4b63-b6d4-12506706cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.532862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a8dc7-b874-4b63-b6d4-12506706cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.537440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:09.556515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ec4a8dc7-b874-4b63-b6d4-12506706cf75 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:09.557789 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ec4a8dc7-b874-4b63-b6d4-12506706cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.567398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1084/2166] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:09.571613 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a8dc7-b874-4b63-b6d4-12506706cf75 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.583152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db8a690792d4ea69bf9b0b273e364a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.583982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db8a690792d4ea69bf9b0b273e364a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.585558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a8dc7-b874-4b63-b6d4-12506706cf75 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.593312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.594756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.595075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.595331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.596146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:09.596576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.598991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.601417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db8a690792d4ea69bf9b0b273e364a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.603286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:09.620330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db8a690792d4ea69bf9b0b273e364a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.625202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1085/2167] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:41:09.626212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db8a690792d4ea69bf9b0b273e364a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:09.629584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.631389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.643773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1083/2168] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:09 2022] DELETE /identity/v3/users/5db8a690792d4ea69bf9b0b273e364a8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:09.667273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb69444-fd6c-43d0-91c2-0903040d0b97 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.684309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.686387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.746917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67de13d-4fa7-4c25-8c84-b9d0968820cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.747687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67de13d-4fa7-4c25-8c84-b9d0968820cc admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.748050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67de13d-4fa7-4c25-8c84-b9d0968820cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.748665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67de13d-4fa7-4c25-8c84-b9d0968820cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.749213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67de13d-4fa7-4c25-8c84-b9d0968820cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.751706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67de13d-4fa7-4c25-8c84-b9d0968820cc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.790551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1086/2169] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:09 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:09.795533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67de13d-4fa7-4c25-8c84-b9d0968820cc admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.801189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb2842-5264-48be-aef5-86e0e35d302f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.878197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21779d11d4b148fab7c92f49340da365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc7f6a7f7674dc995608669989fe2fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.878835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.879125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.879405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.880122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:09.880615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.886162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.890685 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67de13d-4fa7-4c25-8c84-b9d0968820cc admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.895617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3c230-e100-4acb-a295-7ad9f1d952b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.896233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3c230-e100-4acb-a295-7ad9f1d952b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.896653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3c230-e100-4acb-a295-7ad9f1d952b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.896935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3c230-e100-4acb-a295-7ad9f1d952b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.897567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3c230-e100-4acb-a295-7ad9f1d952b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.899542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3c230-e100-4acb-a295-7ad9f1d952b2 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.900715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1084/2170] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:09.905133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.920569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29aac4-85c0-46f7-9084-9ddbca48df38 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.926791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a2a61-889a-4215-8b5f-a8f128c830cc tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21779d11d4b148fab7c92f49340da365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc7f6a7f7674dc995608669989fe2fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.928089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a2a61-889a-4215-8b5f-a8f128c830cc tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.928449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a2a61-889a-4215-8b5f-a8f128c830cc tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.928993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a2a61-889a-4215-8b5f-a8f128c830cc tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.930556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a2a61-889a-4215-8b5f-a8f128c830cc tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.934232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a2a61-889a-4215-8b5f-a8f128c830cc tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.934387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1087/2171] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:09 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:09.936054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3c230-e100-4acb-a295-7ad9f1d952b2 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.949331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3c230-e100-4acb-a295-7ad9f1d952b2 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.955786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4835f-8b1d-4c5d-a3fb-a4fff6de18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.956412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4835f-8b1d-4c5d-a3fb-a4fff6de18cb admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.956686 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4835f-8b1d-4c5d-a3fb-a4fff6de18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.956960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4835f-8b1d-4c5d-a3fb-a4fff6de18cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.957613 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4835f-8b1d-4c5d-a3fb-a4fff6de18cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.959619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4835f-8b1d-4c5d-a3fb-a4fff6de18cb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.972494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1088/2172] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:09.976532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4835f-8b1d-4c5d-a3fb-a4fff6de18cb admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.978938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1085/2173] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:09 2022] POST /identity/v3/projects => generated 354 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:09.984230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a2a61-889a-4215-8b5f-a8f128c830cc tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.987478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4835f-8b1d-4c5d-a3fb-a4fff6de18cb admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.000856 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:10.088024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.089324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.089879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.090366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.091098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.093685 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.095275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:10.099569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a2a61-889a-4215-8b5f-a8f128c830cc tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.113333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21779d11d4b148fab7c92f49340da365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc7f6a7f7674dc995608669989fe2fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.114430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.114430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.125587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1089/2174] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:10.125587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.126992 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:10.139470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.143588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:10.144108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.144230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf98cc-2aff-4c17-b863-53d2603af853 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.146209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.151887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.152523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.152812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.153094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] PATH_INFO: `/v3/projects/18cc1b0990654ad7879df1b98e17a050` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.154957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18cc1b0990654ad7879df1b98e17a050)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.156964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.174011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1086/2175] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:10.175011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.190197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea03d22-8299-4958-b84a-bd3e4ec15c93 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.195124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2bcc-e91f-4779-a56f-c78cacca8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.195855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2bcc-e91f-4779-a56f-c78cacca8f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.196203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2bcc-e91f-4779-a56f-c78cacca8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.196547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2bcc-e91f-4779-a56f-c78cacca8f18 admin admin] PATH_INFO: `/v3/projects/506e5ae01d6149c5a4a17a64dbfbcd01/users/63c47aa256d542bcbc7fab056615a399/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.228701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a2bcc-e91f-4779-a56f-c78cacca8f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506e5ae01d6149c5a4a17a64dbfbcd01, user_id=63c47aa256d542bcbc7fab056615a399, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.234129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a2bcc-e91f-4779-a56f-c78cacca8f18 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.245396 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cc1b0990654ad7879df1b98e17a050', 'request_id': 'req-943e6c8a-889e-4dd1-a803-3cb01100fb2b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.256325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cc1b0990654ad7879df1b98e17a050', 'request_id': 'req-943e6c8a-889e-4dd1-a803-3cb01100fb2b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.262801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1087/2176] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:10 2022] PUT /identity/v3/projects/506e5ae01d6149c5a4a17a64dbfbcd01/users/63c47aa256d542bcbc7fab056615a399/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:10.262801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2bcc-e91f-4779-a56f-c78cacca8f18 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.269598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cc1b0990654ad7879df1b98e17a050', 'request_id': 'req-943e6c8a-889e-4dd1-a803-3cb01100fb2b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.283709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] The token cache is being invalidate because project 18cc1b0990654ad7879df1b98e17a050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:10.284100 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.284835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-943e6c8a-889e-4dd1-a803-3cb01100fb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.286445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1090/2177] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:10 2022] DELETE /identity/v3/projects/18cc1b0990654ad7879df1b98e17a050 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:10.287809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795997c-4f18-4aff-a46e-033422557b30 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.288197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795997c-4f18-4aff-a46e-033422557b30 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.288476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795997c-4f18-4aff-a46e-033422557b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.310747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3795997c-4f18-4aff-a46e-033422557b30 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:10.312055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3795997c-4f18-4aff-a46e-033422557b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:10.345183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2bcc-e91f-4779-a56f-c78cacca8f18 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.352168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21779d11d4b148fab7c92f49340da365', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dc7f6a7f7674dc995608669989fe2fe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.352893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.353463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.354039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] PATH_INFO: `/v3/projects/1f00530a92de403491ee3af1322259d2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.355400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1f00530a92de403491ee3af1322259d2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.358373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.382684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1091/2178] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:10.384656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1e1b-755f-4492-9884-5d64f52d02b8 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.385179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1e1b-755f-4492-9884-5d64f52d02b8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.385603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1e1b-755f-4492-9884-5d64f52d02b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.407698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-67ac1e1b-755f-4492-9884-5d64f52d02b8 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:10.409075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-67ac1e1b-755f-4492-9884-5d64f52d02b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:10.417922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1092/2179] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:10.418921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac1e1b-755f-4492-9884-5d64f52d02b8 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.421264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-67ac1e1b-755f-4492-9884-5d64f52d02b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:10.442293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f00530a92de403491ee3af1322259d2', 'request_id': 'req-48f39663-e98a-4853-8457-3a44618ecc60'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.452496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f00530a92de403491ee3af1322259d2', 'request_id': 'req-48f39663-e98a-4853-8457-3a44618ecc60'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.460239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f00530a92de403491ee3af1322259d2', 'request_id': 'req-48f39663-e98a-4853-8457-3a44618ecc60'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.471797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] The token cache is being invalidate because project 1f00530a92de403491ee3af1322259d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:10.472091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.472790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48f39663-e98a-4853-8457-3a44618ecc60 tempest-VolumeQuotaClassesTest-1564507870 tempest-VolumeQuotaClassesTest-1564507870-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.474653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1088/2180] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:10 2022] DELETE /identity/v3/projects/1f00530a92de403491ee3af1322259d2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:10.475850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc8b71-22c2-40ce-a362-b9780edc25b4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.476135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc8b71-22c2-40ce-a362-b9780edc25b4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.476411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc8b71-22c2-40ce-a362-b9780edc25b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.499776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-30fc8b71-22c2-40ce-a362-b9780edc25b4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:10.502466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-30fc8b71-22c2-40ce-a362-b9780edc25b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:10.508231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:10.510660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac1e1b-755f-4492-9884-5d64f52d02b8 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.553207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:10.598444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1089/2181] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:10.601673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.602335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.602687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc8b71-22c2-40ce-a362-b9780edc25b4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.602791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.602869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.605327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:10.614444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc8b71-22c2-40ce-a362-b9780edc25b4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.620013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.620786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.621160 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.621524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.623224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:10.623708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.624968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.625609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.628423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.642575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1090/2182] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:10.647172 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.655004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1093/2183] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:10.667946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb0cbc-ad14-45dc-9021-0256bce32e43 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.674963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.675711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.676161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.676439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.677332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.679364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.714472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1091/2184] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:10 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:10.718989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.731899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1bd01-723e-439b-b935-542a8a243aca service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.743097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.745529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:10.813463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da316b-b4a3-4c92-9cc2-bb172df67278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.814137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da316b-b4a3-4c92-9cc2-bb172df67278 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.814422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da316b-b4a3-4c92-9cc2-bb172df67278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.814696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da316b-b4a3-4c92-9cc2-bb172df67278 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.815324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da316b-b4a3-4c92-9cc2-bb172df67278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.817279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da316b-b4a3-4c92-9cc2-bb172df67278 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.824623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4537a1-ca91-45d1-8264-5f530c79d5ef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.831289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.831929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.832220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.832480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] PATH_INFO: `/v3/users/77bf8cbb0e504ec98318ffd372027cc6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.833675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77bf8cbb0e504ec98318ffd372027cc6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.848575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1094/2185] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:10 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:10.853463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da316b-b4a3-4c92-9cc2-bb172df67278 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.854603 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.865900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da316b-b4a3-4c92-9cc2-bb172df67278 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.873354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89d1ed-67cc-4cba-9136-a811ba269a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.875784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89d1ed-67cc-4cba-9136-a811ba269a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.875784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89d1ed-67cc-4cba-9136-a811ba269a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.875784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89d1ed-67cc-4cba-9136-a811ba269a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.875784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89d1ed-67cc-4cba-9136-a811ba269a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.877691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89d1ed-67cc-4cba-9136-a811ba269a18 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.889997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1095/2186] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:10.894501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89d1ed-67cc-4cba-9136-a811ba269a18 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.907579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89d1ed-67cc-4cba-9136-a811ba269a18 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.912806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.913472 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.913802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.914113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.914797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.916393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:10.923120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77bf8cbb0e504ec98318ffd372027cc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.923881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77bf8cbb0e504ec98318ffd372027cc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.928074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1096/2187] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:10.932467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:10.934778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:10.944194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77bf8cbb0e504ec98318ffd372027cc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.950781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f430e7-8c5c-4332-8855-72e18274c4d7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:10.952817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77bf8cbb0e504ec98318ffd372027cc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.953498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a53f968f-cdd1-407a-b45c-7db152297791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77bf8cbb0e504ec98318ffd372027cc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:10.956387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f853d6-7745-4119-ad35-c3b28ba79469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:10.957060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f853d6-7745-4119-ad35-c3b28ba79469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.957343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f853d6-7745-4119-ad35-c3b28ba79469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.957683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f853d6-7745-4119-ad35-c3b28ba79469 admin admin] PATH_INFO: `/v3/projects/45d3a1c04edc4eafad03fd0ea9d0a329/users/d7e51aba5f6745db899b691ce6e42abb/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.959938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:10.977582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1092/2188] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:10 2022] DELETE /identity/v3/users/77bf8cbb0e504ec98318ffd372027cc6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:10.977795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f853d6-7745-4119-ad35-c3b28ba79469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d3a1c04edc4eafad03fd0ea9d0a329, user_id=d7e51aba5f6745db899b691ce6e42abb, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:10.979319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619107-ac8d-41c6-ac54-30f8133f99cc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:10.980254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619107-ac8d-41c6-ac54-30f8133f99cc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:10.980254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619107-ac8d-41c6-ac54-30f8133f99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:10.980974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f853d6-7745-4119-ad35-c3b28ba79469 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.004643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1097/2189] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:10 2022] PUT /identity/v3/projects/45d3a1c04edc4eafad03fd0ea9d0a329/users/d7e51aba5f6745db899b691ce6e42abb/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:11.006215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2456-c98f-4c29-94db-b1e3aa83c437 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.006450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2456-c98f-4c29-94db-b1e3aa83c437 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.006728 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2456-c98f-4c29-94db-b1e3aa83c437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.007504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5a619107-ac8d-41c6-ac54-30f8133f99cc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:11.009139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5a619107-ac8d-41c6-ac54-30f8133f99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:11.056166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-59ae2456-c98f-4c29-94db-b1e3aa83c437 None None] MFA Rules not processed for user `d7e51aba5f6745db899b691ce6e42abb`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:11.057575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-59ae2456-c98f-4c29-94db-b1e3aa83c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:11.085618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1093/2190] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:11.094837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619107-ac8d-41c6-ac54-30f8133f99cc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.096419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5a619107-ac8d-41c6-ac54-30f8133f99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:11.174867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1098/2191] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:11.178338 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619107-ac8d-41c6-ac54-30f8133f99cc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.179392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae2456-c98f-4c29-94db-b1e3aa83c437 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.182511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6c07-a721-43d8-b620-8f4d58e19670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.183266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6c07-a721-43d8-b620-8f4d58e19670 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.183637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6c07-a721-43d8-b620-8f4d58e19670 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.184009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6c07-a721-43d8-b620-8f4d58e19670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.187130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:11.191843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae2456-c98f-4c29-94db-b1e3aa83c437 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.196282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf6c07-a721-43d8-b620-8f4d58e19670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.198236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf6c07-a721-43d8-b620-8f4d58e19670 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.202112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bfbbe-b3b2-4e6a-a84b-4d5ee19b6017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.202904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bfbbe-b3b2-4e6a-a84b-4d5ee19b6017 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.203224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bfbbe-b3b2-4e6a-a84b-4d5ee19b6017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.203770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bfbbe-b3b2-4e6a-a84b-4d5ee19b6017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.204423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bfbbe-b3b2-4e6a-a84b-4d5ee19b6017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.207788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bfbbe-b3b2-4e6a-a84b-4d5ee19b6017 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.211248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1094/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:11.249773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1099/2193] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:11 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:11.254090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6c07-a721-43d8-b620-8f4d58e19670 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.267621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf6c07-a721-43d8-b620-8f4d58e19670 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.406985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690c070-0211-4957-a89f-ab421fe19d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.429730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690c070-0211-4957-a89f-ab421fe19d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.430009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690c070-0211-4957-a89f-ab421fe19d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.430174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690c070-0211-4957-a89f-ab421fe19d10 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.430913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690c070-0211-4957-a89f-ab421fe19d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.438307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690c070-0211-4957-a89f-ab421fe19d10 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.481743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1095/2194] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:11 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:11.488756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bfbbe-b3b2-4e6a-a84b-4d5ee19b6017 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.530101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bfbbe-b3b2-4e6a-a84b-4d5ee19b6017 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.537224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e86fb-b56f-43ad-9cc3-cc976dce6af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.537911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e86fb-b56f-43ad-9cc3-cc976dce6af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.538239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e86fb-b56f-43ad-9cc3-cc976dce6af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.538674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e86fb-b56f-43ad-9cc3-cc976dce6af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.539460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e86fb-b56f-43ad-9cc3-cc976dce6af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.544663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e86fb-b56f-43ad-9cc3-cc976dce6af9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.585208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1100/2195] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:11.589295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690c070-0211-4957-a89f-ab421fe19d10 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.603932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690c070-0211-4957-a89f-ab421fe19d10 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.610532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.611250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.611532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.611810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] PATH_INFO: `/v3/projects/260ed4a7ee9e45a7a834d4c56347fdf8/users/e7c24fd32bbb4cfba4934f36535c31af/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.646054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260ed4a7ee9e45a7a834d4c56347fdf8, user_id=e7c24fd32bbb4cfba4934f36535c31af, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.652106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.685787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1096/2196] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:11 2022] PUT /identity/v3/projects/260ed4a7ee9e45a7a834d4c56347fdf8/users/e7c24fd32bbb4cfba4934f36535c31af/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:11.690764 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e86fb-b56f-43ad-9cc3-cc976dce6af9 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.703210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e86fb-b56f-43ad-9cc3-cc976dce6af9 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.780596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.782910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:11.790335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:11.871822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c9192-f0dc-4bb0-aa3f-bb99b0a5d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.872585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c9192-f0dc-4bb0-aa3f-bb99b0a5d63d admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.872862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c9192-f0dc-4bb0-aa3f-bb99b0a5d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.873155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c9192-f0dc-4bb0-aa3f-bb99b0a5d63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.873805 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c9192-f0dc-4bb0-aa3f-bb99b0a5d63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.875503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c9192-f0dc-4bb0-aa3f-bb99b0a5d63d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.908088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1101/2197] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:11.915168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c9192-f0dc-4bb0-aa3f-bb99b0a5d63d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.936085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c9192-f0dc-4bb0-aa3f-bb99b0a5d63d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.947271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b455d7-c514-4a4e-8ddb-68525a3c9fb5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.952590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b1467-7326-4d01-b069-9b5d9915abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.953358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1467-7326-4d01-b069-9b5d9915abfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.953645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1467-7326-4d01-b069-9b5d9915abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.953982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1467-7326-4d01-b069-9b5d9915abfd admin admin] PATH_INFO: `/v3/projects/260ed4a7ee9e45a7a834d4c56347fdf8/users/e7c24fd32bbb4cfba4934f36535c31af/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.956744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b1467-7326-4d01-b069-9b5d9915abfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=260ed4a7ee9e45a7a834d4c56347fdf8, user_id=e7c24fd32bbb4cfba4934f36535c31af, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.971578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.972538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.972883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.973165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] PATH_INFO: `/v3/projects/4d19d08a363d4e459dc3d2dd4d2307c6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.975255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d19d08a363d4e459dc3d2dd4d2307c6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.976475 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b1467-7326-4d01-b069-9b5d9915abfd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.977217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:12.030802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1102/2198] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:11 2022] PUT /identity/v3/projects/260ed4a7ee9e45a7a834d4c56347fdf8/users/e7c24fd32bbb4cfba4934f36535c31af/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:12.032347 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a516-6ec1-4c86-a530-4b43aefcf558 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:12.032637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a516-6ec1-4c86-a530-4b43aefcf558 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:12.033226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a516-6ec1-4c86-a530-4b43aefcf558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:12.064688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d19d08a363d4e459dc3d2dd4d2307c6', 'request_id': 'req-6a5d6173-a470-49b3-b364-b3170ad6e874'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.077720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d19d08a363d4e459dc3d2dd4d2307c6', 'request_id': 'req-6a5d6173-a470-49b3-b364-b3170ad6e874'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.086315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d19d08a363d4e459dc3d2dd4d2307c6', 'request_id': 'req-6a5d6173-a470-49b3-b364-b3170ad6e874'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.101032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-6408a516-6ec1-4c86-a530-4b43aefcf558 None None] MFA Rules not processed for user `e7c24fd32bbb4cfba4934f36535c31af`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:12.107806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] The token cache is being invalidate because project 4d19d08a363d4e459dc3d2dd4d2307c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:12.108648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.109514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.110959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6408a516-6ec1-4c86-a530-4b43aefcf558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:12.114323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1097/2199] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:11 2022] DELETE /identity/v3/projects/4d19d08a363d4e459dc3d2dd4d2307c6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:12.118255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:12.119194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:12.231996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d6173-a470-49b3-b364-b3170ad6e874 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:12.237914 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:12.238649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:12.239128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:12.239528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] PATH_INFO: `/v3/users/21779d11d4b148fab7c92f49340da365` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:12.241141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21779d11d4b148fab7c92f49340da365)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:12.243662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:12.252916 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1103/2200] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:12.265404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a516-6ec1-4c86-a530-4b43aefcf558 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:12.268179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6408a516-6ec1-4c86-a530-4b43aefcf558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:12.299546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:12.316870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21779d11d4b148fab7c92f49340da365'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.318043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21779d11d4b148fab7c92f49340da365'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.336737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21779d11d4b148fab7c92f49340da365'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.339737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:12.350541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21779d11d4b148fab7c92f49340da365'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.351663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21779d11d4b148fab7c92f49340da365'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.365938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a516-6ec1-4c86-a530-4b43aefcf558 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:12.371114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:12.372076 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:12.373041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:12.373331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:12.375512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:12.385185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1098/2201] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:12 2022] DELETE /identity/v3/users/21779d11d4b148fab7c92f49340da365 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:12.473239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:12.475747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:12.488316 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1104/2202] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:12.817153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:12.818663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:12.985366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19139652-8c9b-4921-a6d1-6bc07bee4b5f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:12.996336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:12.998575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:12.999774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.000545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.000827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.001102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] PATH_INFO: `/v3/users/e556ad9f07974ec78881000d33d1eaa1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.004690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e556ad9f07974ec78881000d33d1eaa1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.007974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.062428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083bd35-59ad-4892-8769-5b5f021f879f service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:13.084669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.087115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.087257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.087645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] PATH_INFO: `/v3/projects/5dc7f6a7f7674dc995608669989fe2fe` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.089498 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc7f6a7f7674dc995608669989fe2fe)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.091727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.121552 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e556ad9f07974ec78881000d33d1eaa1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.122936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e556ad9f07974ec78881000d33d1eaa1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.139854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e556ad9f07974ec78881000d33d1eaa1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.151634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e556ad9f07974ec78881000d33d1eaa1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.152261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a4d575c3-b57e-4558-9a7e-f8f80d7cbdaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e556ad9f07974ec78881000d33d1eaa1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.178396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1099/2203] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:12 2022] DELETE /identity/v3/users/e556ad9f07974ec78881000d33d1eaa1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:13.195266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271be9d-cb34-4090-8fe9-02c0c565b265 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.195563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271be9d-cb34-4090-8fe9-02c0c565b265 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.195803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271be9d-cb34-4090-8fe9-02c0c565b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.206551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc7f6a7f7674dc995608669989fe2fe', 'request_id': 'req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.215923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc7f6a7f7674dc995608669989fe2fe', 'request_id': 'req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.232791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc7f6a7f7674dc995608669989fe2fe', 'request_id': 'req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.244386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e271be9d-cb34-4090-8fe9-02c0c565b265 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:13.246003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e271be9d-cb34-4090-8fe9-02c0c565b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.258320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] The token cache is being invalidate because project 5dc7f6a7f7674dc995608669989fe2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:13.258634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.259469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.261505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1105/2204] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:12 2022] DELETE /identity/v3/projects/5dc7f6a7f7674dc995608669989fe2fe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:13.262489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:13.265033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.283351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:13.329951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1100/2205] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:13.331293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081bbc7-9fa9-418e-bf24-c3f82835b318 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.331697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081bbc7-9fa9-418e-bf24-c3f82835b318 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.331976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081bbc7-9fa9-418e-bf24-c3f82835b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.352197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ff313-5de7-4261-a33d-36ed2a8bd16a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:13.357833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.358603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.358882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.359151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] PATH_INFO: `/v3/users/0ac5162dddc04796ab9ac29b2030c6e3` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.360306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac5162dddc04796ab9ac29b2030c6e3)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.361461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8081bbc7-9fa9-418e-bf24-c3f82835b318 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:13.362328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.362940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8081bbc7-9fa9-418e-bf24-c3f82835b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.380500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1101/2206] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:13.380500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081bbc7-9fa9-418e-bf24-c3f82835b318 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:13.382166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8081bbc7-9fa9-418e-bf24-c3f82835b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.391527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:13.429626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac5162dddc04796ab9ac29b2030c6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.430552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac5162dddc04796ab9ac29b2030c6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.446936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac5162dddc04796ab9ac29b2030c6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.455761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac5162dddc04796ab9ac29b2030c6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.456578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-1fd10878-649a-4bb7-9b26-b3a1b9426a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac5162dddc04796ab9ac29b2030c6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:13.464973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081bbc7-9fa9-418e-bf24-c3f82835b318 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:13.468908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99294bde-7563-4bf6-89ac-f71b5356ab1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.469820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99294bde-7563-4bf6-89ac-f71b5356ab1f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.470167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99294bde-7563-4bf6-89ac-f71b5356ab1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.470439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99294bde-7563-4bf6-89ac-f71b5356ab1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.472433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-99294bde-7563-4bf6-89ac-f71b5356ab1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.472553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1106/2207] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:13 2022] DELETE /identity/v3/users/0ac5162dddc04796ab9ac29b2030c6e3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:13.473740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c260793-8ffe-4bb4-b8aa-0c83a5a0da78 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.474063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c260793-8ffe-4bb4-b8aa-0c83a5a0da78 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.474336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c260793-8ffe-4bb4-b8aa-0c83a5a0da78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.487919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99294bde-7563-4bf6-89ac-f71b5356ab1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.490244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99294bde-7563-4bf6-89ac-f71b5356ab1f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.499354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8c260793-8ffe-4bb4-b8aa-0c83a5a0da78 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:13.500580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8c260793-8ffe-4bb4-b8aa-0c83a5a0da78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.501567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1102/2208] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:13.503215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5d9d-1f65-440a-8103-980e5b950667 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.503584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5d9d-1f65-440a-8103-980e5b950667 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.503949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5d9d-1f65-440a-8103-980e5b950667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.525253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0fce5d9d-1f65-440a-8103-980e5b950667 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:13.526537 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0fce5d9d-1f65-440a-8103-980e5b950667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.592676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1107/2209] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:13.594323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c260793-8ffe-4bb4-b8aa-0c83a5a0da78 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:13.607309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c260793-8ffe-4bb4-b8aa-0c83a5a0da78 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:13.613396 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.614137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.614400 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.614765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.615743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:13.616254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.618193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.644768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1108/2210] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:41:13.651270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:13.651405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1103/2211] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:13.663473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161983ad-dfb2-467f-84d6-6ee32d2d7867 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:13.674034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d699b78-af1d-4aae-8231-da084097c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.674951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699b78-af1d-4aae-8231-da084097c756 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.675399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699b78-af1d-4aae-8231-da084097c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.675711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699b78-af1d-4aae-8231-da084097c756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.682101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d699b78-af1d-4aae-8231-da084097c756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.685293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d699b78-af1d-4aae-8231-da084097c756 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.696421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce5d9d-1f65-440a-8103-980e5b950667 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:13.699126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0fce5d9d-1f65-440a-8103-980e5b950667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.736353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1109/2212] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:13 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:13.740938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d699b78-af1d-4aae-8231-da084097c756 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:13.813869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce5d9d-1f65-440a-8103-980e5b950667 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:13.860631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:13.896645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d699b78-af1d-4aae-8231-da084097c756 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:13.912189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca897671-5734-4c75-86ef-b5a8122916ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.912963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca897671-5734-4c75-86ef-b5a8122916ee service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.913378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca897671-5734-4c75-86ef-b5a8122916ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.913763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca897671-5734-4c75-86ef-b5a8122916ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.914643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ea2f4-da5f-4801-bb85-0e51bfdff709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.915640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ea2f4-da5f-4801-bb85-0e51bfdff709 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.924421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ea2f4-da5f-4801-bb85-0e51bfdff709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.925302 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ea2f4-da5f-4801-bb85-0e51bfdff709 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.927979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca897671-5734-4c75-86ef-b5a8122916ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.928780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ea2f4-da5f-4801-bb85-0e51bfdff709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.930174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca897671-5734-4c75-86ef-b5a8122916ee service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.935767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ea2f4-da5f-4801-bb85-0e51bfdff709 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.950501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:13.955366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1104/2213] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:13.994700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1110/2214] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:13 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:14.000218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca897671-5734-4c75-86ef-b5a8122916ee service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:14.014349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca897671-5734-4c75-86ef-b5a8122916ee service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:14.025766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc601f9-dc7e-46e2-b97a-13b971a9188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:14.026418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc601f9-dc7e-46e2-b97a-13b971a9188d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.026701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc601f9-dc7e-46e2-b97a-13b971a9188d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.026974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc601f9-dc7e-46e2-b97a-13b971a9188d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.027626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc601f9-dc7e-46e2-b97a-13b971a9188d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:14.045792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc601f9-dc7e-46e2-b97a-13b971a9188d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:14.074311 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1105/2215] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:14.082126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ea2f4-da5f-4801-bb85-0e51bfdff709 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:14.102676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ea2f4-da5f-4801-bb85-0e51bfdff709 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:14.119232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad129a-e5b4-4461-a530-235724a4ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:14.120432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad129a-e5b4-4461-a530-235724a4ebaf admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.121855 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad129a-e5b4-4461-a530-235724a4ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.132126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad129a-e5b4-4461-a530-235724a4ebaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.142667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad129a-e5b4-4461-a530-235724a4ebaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:14.145980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad129a-e5b4-4461-a530-235724a4ebaf admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:14.167097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1111/2216] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:14.171129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc601f9-dc7e-46e2-b97a-13b971a9188d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:14.188754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc601f9-dc7e-46e2-b97a-13b971a9188d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:14.206574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:14.206741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.207033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.207312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] PATH_INFO: `/v3/projects/2c0f611fab334b07bc9dd08d3a26ec3f/users/65484e81db9d4bb1b83287cfdab28906/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.235428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0f611fab334b07bc9dd08d3a26ec3f, user_id=65484e81db9d4bb1b83287cfdab28906, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:14.239571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:14.280947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf3f0d-a4ed-4a78-85a0-8a5e86aede9e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.281608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf3f0d-a4ed-4a78-85a0-8a5e86aede9e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.282060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf3f0d-a4ed-4a78-85a0-8a5e86aede9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.289917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1106/2217] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:14 2022] PUT /identity/v3/projects/2c0f611fab334b07bc9dd08d3a26ec3f/users/65484e81db9d4bb1b83287cfdab28906/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:14.331634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-eddf3f0d-a4ed-4a78-85a0-8a5e86aede9e None None] MFA Rules not processed for user `65484e81db9d4bb1b83287cfdab28906`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:14.333455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-eddf3f0d-a4ed-4a78-85a0-8a5e86aede9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:14.342612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:14.350777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:14.519095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a853a-3991-4148-a01b-70a64177d0d6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:14.530253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:14.530894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.531176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.531457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] PATH_INFO: `/v3/users/7b366ccd93a04525aaa2ce5f1662d4c4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.534861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b366ccd93a04525aaa2ce5f1662d4c4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:14.546411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:14.553231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1112/2218] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:14.554453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf3f0d-a4ed-4a78-85a0-8a5e86aede9e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:14.556364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-eddf3f0d-a4ed-4a78-85a0-8a5e86aede9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:14.583354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf3f0d-a4ed-4a78-85a0-8a5e86aede9e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:14.589932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:14.590587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.590869 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.591172 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] PATH_INFO: `/v3/projects/eb1523bb9d8f428db870aa79fb9f1708` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.592341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1523bb9d8f428db870aa79fb9f1708)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:14.596356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:14.629893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b366ccd93a04525aaa2ce5f1662d4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.630585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b366ccd93a04525aaa2ce5f1662d4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.672611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b366ccd93a04525aaa2ce5f1662d4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.691344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b366ccd93a04525aaa2ce5f1662d4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.692471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b366ccd93a04525aaa2ce5f1662d4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.700086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1523bb9d8f428db870aa79fb9f1708', 'request_id': 'req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.714247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1107/2219] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:14 2022] DELETE /identity/v3/users/7b366ccd93a04525aaa2ce5f1662d4c4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:14.715469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:14.717066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:14.720426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1523bb9d8f428db870aa79fb9f1708', 'request_id': 'req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.733506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:14.738366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1523bb9d8f428db870aa79fb9f1708', 'request_id': 'req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.765585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] The token cache is being invalidate because project eb1523bb9d8f428db870aa79fb9f1708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:14.766341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.767277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.769147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1113/2220] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:14 2022] DELETE /identity/v3/projects/eb1523bb9d8f428db870aa79fb9f1708 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:14.770589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:14.778093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:14.815183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083b51c-4f99-4d7d-89c6-259f27d6dc3f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:14.820637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:14.821402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.821786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.822192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] PATH_INFO: `/v3/projects/f85c2e4e4e8e4475955441149e7769ab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.823602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85c2e4e4e8e4475955441149e7769ab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:14.826043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:14.884567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63099e-c8db-4e78-9ceb-761ca6eb4e60 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:14.891054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:14.891980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85c2e4e4e8e4475955441149e7769ab', 'request_id': 'req-316b7eee-4637-4cd4-9377-80a30cfff79f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.915105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85c2e4e4e8e4475955441149e7769ab', 'request_id': 'req-316b7eee-4637-4cd4-9377-80a30cfff79f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.928463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85c2e4e4e8e4475955441149e7769ab', 'request_id': 'req-316b7eee-4637-4cd4-9377-80a30cfff79f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.944611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] The token cache is being invalidate because project f85c2e4e4e8e4475955441149e7769ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:14.944901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.945577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-316b7eee-4637-4cd4-9377-80a30cfff79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:14.949923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1108/2221] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:14 2022] DELETE /identity/v3/projects/f85c2e4e4e8e4475955441149e7769ab => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:14.949923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951c9f-b131-4524-a4b9-1e1071e83276 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.949923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951c9f-b131-4524-a4b9-1e1071e83276 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.949923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951c9f-b131-4524-a4b9-1e1071e83276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.964136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c16885de9e4e82bcbede361e548ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:14.965387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:14.965684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:14.966753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:14.968877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:14.975133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5e951c9f-b131-4524-a4b9-1e1071e83276 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:14.976976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5e951c9f-b131-4524-a4b9-1e1071e83276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:15.056405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.058020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.064810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1109/2222] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:15.066506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20254dd-ea8e-4ff5-99fb-67a2835b530e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.066803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20254dd-ea8e-4ff5-99fb-67a2835b530e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.067084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20254dd-ea8e-4ff5-99fb-67a2835b530e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.078654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1114/2223] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:15.079584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.082881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:15.098831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ce3f-0b8e-406d-a73d-9284bb7b91ab service glance] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.103528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f20254dd-ea8e-4ff5-99fb-67a2835b530e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:15.104866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f20254dd-ea8e-4ff5-99fb-67a2835b530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:15.105606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.106513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.106989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.107406 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] PATH_INFO: `/v3/users/f00e283ab1f54c808daa21d2a2586443` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.109102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00e283ab1f54c808daa21d2a2586443)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.111467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.130642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1110/2224] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:15.131897 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20254dd-ea8e-4ff5-99fb-67a2835b530e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.135933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f20254dd-ea8e-4ff5-99fb-67a2835b530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:15.190872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00e283ab1f54c808daa21d2a2586443'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.192066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00e283ab1f54c808daa21d2a2586443'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.209880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00e283ab1f54c808daa21d2a2586443'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.219658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00e283ab1f54c808daa21d2a2586443'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.220608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-8cca4e7e-7a55-4ad2-9848-525c81052edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00e283ab1f54c808daa21d2a2586443'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.227538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:15.244102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1115/2225] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:15 2022] DELETE /identity/v3/users/f00e283ab1f54c808daa21d2a2586443 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:15.244102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648495-6c73-46d6-98e4-506dd0446a3a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.244102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648495-6c73-46d6-98e4-506dd0446a3a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.244102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648495-6c73-46d6-98e4-506dd0446a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.258762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20254dd-ea8e-4ff5-99fb-67a2835b530e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.303942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ba648495-6c73-46d6-98e4-506dd0446a3a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:15.305619 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ba648495-6c73-46d6-98e4-506dd0446a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:15.337026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.338330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.338669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.338951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.341583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:15.386744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:15.462633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1116/2226] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:15.467819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648495-6c73-46d6-98e4-506dd0446a3a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.471448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.473043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.488261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648495-6c73-46d6-98e4-506dd0446a3a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.495227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1111/2227] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:15.500836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.501571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.501892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.502153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.502819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:15.503125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.504767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.534105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1117/2228] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:15.538613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.554404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0b15e-1653-42d9-9526-a3c8fce27ab7 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.573671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8a6b8-c9dd-427b-be70-aa691e0a2ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.577297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8a6b8-c9dd-427b-be70-aa691e0a2ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.578084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8a6b8-c9dd-427b-be70-aa691e0a2ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.578970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8a6b8-c9dd-427b-be70-aa691e0a2ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.582625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8a6b8-c9dd-427b-be70-aa691e0a2ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.588495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8a6b8-c9dd-427b-be70-aa691e0a2ab3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.651708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.656258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:15.659731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1112/2229] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:15 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:15.667222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8a6b8-c9dd-427b-be70-aa691e0a2ab3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.684017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a08f01-03fc-43ca-9e40-4c838bc89622 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.815120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8a6b8-c9dd-427b-be70-aa691e0a2ab3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.834220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8fc1b-b73a-407e-9bde-8d731dfa171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.834855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8fc1b-b73a-407e-9bde-8d731dfa171d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.835139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8fc1b-b73a-407e-9bde-8d731dfa171d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.835415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8fc1b-b73a-407e-9bde-8d731dfa171d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.836060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8fc1b-b73a-407e-9bde-8d731dfa171d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.838139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8fc1b-b73a-407e-9bde-8d731dfa171d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.849471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.851070 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.852324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.852876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] PATH_INFO: `/v3/users/d7e51aba5f6745db899b691ce6e42abb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.861192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e51aba5f6745db899b691ce6e42abb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.865459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.885016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1113/2230] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:15 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:15.889556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8fc1b-b73a-407e-9bde-8d731dfa171d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.912732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8fc1b-b73a-407e-9bde-8d731dfa171d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.927587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437941-2af7-4a6a-859e-a6a77cd1a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.928228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437941-2af7-4a6a-859e-a6a77cd1a95f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.928511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437941-2af7-4a6a-859e-a6a77cd1a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.928787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437941-2af7-4a6a-859e-a6a77cd1a95f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.930005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67437941-2af7-4a6a-859e-a6a77cd1a95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.931234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67437941-2af7-4a6a-859e-a6a77cd1a95f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.938029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:15.952972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1114/2231] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:15.956809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437941-2af7-4a6a-859e-a6a77cd1a95f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.974485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e51aba5f6745db899b691ce6e42abb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.975639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e51aba5f6745db899b691ce6e42abb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.980262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437941-2af7-4a6a-859e-a6a77cd1a95f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.986553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.987825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.987825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.987825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.988362 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.990279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:16.001134 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e51aba5f6745db899b691ce6e42abb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.014356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1115/2232] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:16.018273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.031693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.032373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e51aba5f6745db899b691ce6e42abb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.037642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ed945ee7-f1eb-4917-94f4-3fa45b77cc1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e51aba5f6745db899b691ce6e42abb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.051819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db2294-b3db-4167-82b6-61b81cf42158 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:16.064504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1118/2233] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:15 2022] DELETE /identity/v3/users/d7e51aba5f6745db899b691ce6e42abb => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:16.069174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d71ed-551d-4757-959e-5a5eefa5975d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.069467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d71ed-551d-4757-959e-5a5eefa5975d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.070226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d71ed-551d-4757-959e-5a5eefa5975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.072094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7578e1-556b-4ecf-95d7-37970ec0c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:16.072837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7578e1-556b-4ecf-95d7-37970ec0c680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.073049 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7578e1-556b-4ecf-95d7-37970ec0c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.073336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7578e1-556b-4ecf-95d7-37970ec0c680 admin admin] PATH_INFO: `/v3/projects/7a38648dbf8b42c48be11c87e6b621b6/users/f7c2b0074fb04df5b55bf7363a9e8f12/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.108566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7578e1-556b-4ecf-95d7-37970ec0c680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a38648dbf8b42c48be11c87e6b621b6, user_id=f7c2b0074fb04df5b55bf7363a9e8f12, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:16.111316 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7578e1-556b-4ecf-95d7-37970ec0c680 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:16.133746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-2e1d71ed-551d-4757-959e-5a5eefa5975d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:16.135150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2e1d71ed-551d-4757-959e-5a5eefa5975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.159245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1116/2234] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:16 2022] PUT /identity/v3/projects/7a38648dbf8b42c48be11c87e6b621b6/users/f7c2b0074fb04df5b55bf7363a9e8f12/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:16.163723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b327da-df9a-422b-9f54-4bc7789c7620 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.164083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b327da-df9a-422b-9f54-4bc7789c7620 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.164371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b327da-df9a-422b-9f54-4bc7789c7620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.212030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-74b327da-df9a-422b-9f54-4bc7789c7620 None None] MFA Rules not processed for user `f7c2b0074fb04df5b55bf7363a9e8f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:16.214062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74b327da-df9a-422b-9f54-4bc7789c7620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.223455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:16.286231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1119/2235] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:16.287307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d71ed-551d-4757-959e-5a5eefa5975d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.293676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2e1d71ed-551d-4757-959e-5a5eefa5975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.327328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d71ed-551d-4757-959e-5a5eefa5975d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:16.360759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1117/2236] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:16.361768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b327da-df9a-422b-9f54-4bc7789c7620 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.363199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74b327da-df9a-422b-9f54-4bc7789c7620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.443665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:16.444473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.444785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.445063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] PATH_INFO: `/v3/projects/759b7d6ae1dd49bb888b6325b7d3db76` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.446464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759b7d6ae1dd49bb888b6325b7d3db76)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:16.448630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:16.495390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b327da-df9a-422b-9f54-4bc7789c7620 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:16.500120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:16.500842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.501855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.501855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.514068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:16.516437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:16.534557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1118/2237] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:16.535541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.539725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.555009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759b7d6ae1dd49bb888b6325b7d3db76', 'request_id': 'req-15364675-c49a-44e0-948b-cfc94df3dad0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.570497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759b7d6ae1dd49bb888b6325b7d3db76', 'request_id': 'req-15364675-c49a-44e0-948b-cfc94df3dad0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.575135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24bcc8-0e1a-41f2-b6b1-b633531c43b2 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:16.589778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759b7d6ae1dd49bb888b6325b7d3db76', 'request_id': 'req-15364675-c49a-44e0-948b-cfc94df3dad0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.636251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] The token cache is being invalidate because project 759b7d6ae1dd49bb888b6325b7d3db76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:16.638818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.642168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.645643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1120/2238] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:16 2022] DELETE /identity/v3/projects/759b7d6ae1dd49bb888b6325b7d3db76 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:16.647891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.651984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.728110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:16.755037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:16.755831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.756211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.756584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] PATH_INFO: `/v3/projects/be3aee92f4974126aa3ef273055cb4d1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.758340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3aee92f4974126aa3ef273055cb4d1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:16.760480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:16.821458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364675-c49a-44e0-948b-cfc94df3dad0 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:16.833920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd489e-1175-4088-bc07-fe0bee9595ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:16.834371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd489e-1175-4088-bc07-fe0bee9595ff service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.834768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd489e-1175-4088-bc07-fe0bee9595ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.835162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd489e-1175-4088-bc07-fe0bee9595ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.837632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-defd489e-1175-4088-bc07-fe0bee9595ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.887797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3aee92f4974126aa3ef273055cb4d1', 'request_id': 'req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.902994 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:16.905764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3aee92f4974126aa3ef273055cb4d1', 'request_id': 'req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.914553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3aee92f4974126aa3ef273055cb4d1', 'request_id': 'req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.942477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] The token cache is being invalidate because project be3aee92f4974126aa3ef273055cb4d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:16.942774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.945079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.947619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1119/2239] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:16 2022] DELETE /identity/v3/projects/be3aee92f4974126aa3ef273055cb4d1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:16.948498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.953730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:17.008477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd489e-1175-4088-bc07-fe0bee9595ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.010152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd489e-1175-4088-bc07-fe0bee9595ff service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.049914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1121/2240] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:17.051374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4f04-5bf9-4e46-b2fd-8433ce152481 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.051671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4f04-5bf9-4e46-b2fd-8433ce152481 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.051973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b4f04-5bf9-4e46-b2fd-8433ce152481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.075290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34f24b-1e5d-4c96-8c57-4b213db1fbed admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.111243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.112264 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.113700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.114147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] PATH_INFO: `/v3/users/c7f7b8a0340946a3a2ba6479edaf3300` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.116883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f7b8a0340946a3a2ba6479edaf3300)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.131643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.148267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-409b4f04-5bf9-4e46-b2fd-8433ce152481 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:17.151832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-409b4f04-5bf9-4e46-b2fd-8433ce152481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:17.197241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1122/2241] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:17.207007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4f04-5bf9-4e46-b2fd-8433ce152481 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.210737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-409b4f04-5bf9-4e46-b2fd-8433ce152481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:17.236605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f7b8a0340946a3a2ba6479edaf3300'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.239048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f7b8a0340946a3a2ba6479edaf3300'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.240688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b4f04-5bf9-4e46-b2fd-8433ce152481 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.261967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.263659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.267156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.267730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] PATH_INFO: `/v3/projects/45d3a1c04edc4eafad03fd0ea9d0a329` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.272598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f7b8a0340946a3a2ba6479edaf3300'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.273466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d3a1c04edc4eafad03fd0ea9d0a329)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.283622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.289887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f7b8a0340946a3a2ba6479edaf3300'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.291969 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97b9afd0-b5c6-4024-9519-1c3189cdc69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f7b8a0340946a3a2ba6479edaf3300'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.328127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1120/2242] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:16 2022] DELETE /identity/v3/users/c7f7b8a0340946a3a2ba6479edaf3300 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:17.329214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a04806-217a-4fb5-83a1-31f14e8e0432 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.339279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a04806-217a-4fb5-83a1-31f14e8e0432 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.339830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a04806-217a-4fb5-83a1-31f14e8e0432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.377951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:17.399451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d3a1c04edc4eafad03fd0ea9d0a329', 'request_id': 'req-20552155-b0fd-4060-9292-2240cf74e9af'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.407333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d3a1c04edc4eafad03fd0ea9d0a329', 'request_id': 'req-20552155-b0fd-4060-9292-2240cf74e9af'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.413478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d5a04806-217a-4fb5-83a1-31f14e8e0432 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:17.417684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d5a04806-217a-4fb5-83a1-31f14e8e0432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:17.425879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d3a1c04edc4eafad03fd0ea9d0a329', 'request_id': 'req-20552155-b0fd-4060-9292-2240cf74e9af'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.442144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] The token cache is being invalidate because project 45d3a1c04edc4eafad03fd0ea9d0a329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:17.442429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.443106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.448787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1123/2243] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:17 2022] DELETE /identity/v3/projects/45d3a1c04edc4eafad03fd0ea9d0a329 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:17.449399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.452879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:17.633763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20552155-b0fd-4060-9292-2240cf74e9af admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.649228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1121/2244] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:17.651015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a04806-217a-4fb5-83a1-31f14e8e0432 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.653043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.663153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.663652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.664150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] PATH_INFO: `/v3/users/e7c24fd32bbb4cfba4934f36535c31af` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.665807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c24fd32bbb4cfba4934f36535c31af)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.668436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.674110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a04806-217a-4fb5-83a1-31f14e8e0432 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.684074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.685689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.686435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.687014 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.688015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:17.688470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.692399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.723993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1122/2245] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:41:17.727890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.751597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d0f8c-dfc2-4654-91eb-8c4e90f2f858 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.764015 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c23d60-a842-41be-9c59-500e04beb4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.764707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23d60-a842-41be-9c59-500e04beb4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.764994 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23d60-a842-41be-9c59-500e04beb4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.765268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c23d60-a842-41be-9c59-500e04beb4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.765942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c23d60-a842-41be-9c59-500e04beb4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.768062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c23d60-a842-41be-9c59-500e04beb4f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.849609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1123/2246] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:17 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:17.855087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c23d60-a842-41be-9c59-500e04beb4f9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.888410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:17.894283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c24fd32bbb4cfba4934f36535c31af'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.894968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c24fd32bbb4cfba4934f36535c31af'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.941042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c24fd32bbb4cfba4934f36535c31af'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.971587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c24fd32bbb4cfba4934f36535c31af'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.973510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c24fd32bbb4cfba4934f36535c31af'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:17.990750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1124/2247] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:17 2022] DELETE /identity/v3/users/e7c24fd32bbb4cfba4934f36535c31af => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:17.991753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.993770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.012144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c23d60-a842-41be-9c59-500e04beb4f9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.082142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362c8e-8bee-4478-9785-a155ab4195f4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.090484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.091428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.092325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.092325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] PATH_INFO: `/v3/projects/37e581e2dacb44e298e366e44a08e36e` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.094656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e581e2dacb44e298e366e44a08e36e)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.097093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.119816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef4352-3e3a-403d-ab06-e8c82642ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.121315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4352-3e3a-403d-ab06-e8c82642ea0d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.121802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4352-3e3a-403d-ab06-e8c82642ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.122933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef4352-3e3a-403d-ab06-e8c82642ea0d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.123948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef4352-3e3a-403d-ab06-e8c82642ea0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.127386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef4352-3e3a-403d-ab06-e8c82642ea0d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.166912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1124/2248] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:17 2022] POST /identity/v3/users => generated 286 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:18.170559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58d0e-d5c8-419c-bf87-c43cf2b730bc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.170901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58d0e-d5c8-419c-bf87-c43cf2b730bc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.171187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58d0e-d5c8-419c-bf87-c43cf2b730bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.191466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e581e2dacb44e298e366e44a08e36e', 'request_id': 'req-a65e2879-178d-4a23-bfa7-ad56bb714306'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.196148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:18.198720 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e581e2dacb44e298e366e44a08e36e', 'request_id': 'req-a65e2879-178d-4a23-bfa7-ad56bb714306'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.208513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e581e2dacb44e298e366e44a08e36e', 'request_id': 'req-a65e2879-178d-4a23-bfa7-ad56bb714306'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.217153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6aa58d0e-d5c8-419c-bf87-c43cf2b730bc None None] MFA Rules not processed for user `63c47aa256d542bcbc7fab056615a399`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:18.218641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6aa58d0e-d5c8-419c-bf87-c43cf2b730bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.224588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] The token cache is being invalidate because project 37e581e2dacb44e298e366e44a08e36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:18.224965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.225734 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.227476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1125/2249] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:17 2022] DELETE /identity/v3/projects/37e581e2dacb44e298e366e44a08e36e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:18.228448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.234004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.312573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:18.332238 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e2879-178d-4a23-bfa7-ad56bb714306 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.334005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1125/2250] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:18.335782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d67c2-c663-4a63-8d0d-be594b2e9462 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.336411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d67c2-c663-4a63-8d0d-be594b2e9462 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.336578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d67c2-c663-4a63-8d0d-be594b2e9462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.345530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.346292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.347771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.354397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.356651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.359217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.374352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1126/2251] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:18.375311 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.381109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.405050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-273d67c2-c663-4a63-8d0d-be594b2e9462 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:18.406317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-273d67c2-c663-4a63-8d0d-be594b2e9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.426699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1126/2252] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:18.434069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d67c2-c663-4a63-8d0d-be594b2e9462 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.438878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-273d67c2-c663-4a63-8d0d-be594b2e9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.454062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d67c2-c663-4a63-8d0d-be594b2e9462 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.472621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.473325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.473614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.473940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] PATH_INFO: `/v3/projects/260ed4a7ee9e45a7a834d4c56347fdf8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.475403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260ed4a7ee9e45a7a834d4c56347fdf8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.477355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.524418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19c354-ee0c-4cc1-9e4d-b3a1d3b5d37d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.539938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afc300-f28f-4571-a412-de3d7df5e340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.542934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afc300-f28f-4571-a412-de3d7df5e340 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.543661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afc300-f28f-4571-a412-de3d7df5e340 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.544876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afc300-f28f-4571-a412-de3d7df5e340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.553981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260ed4a7ee9e45a7a834d4c56347fdf8', 'request_id': 'req-0427a15c-5315-4929-ad4a-d2d3073b9217'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.566057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afc300-f28f-4571-a412-de3d7df5e340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.569185 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260ed4a7ee9e45a7a834d4c56347fdf8', 'request_id': 'req-0427a15c-5315-4929-ad4a-d2d3073b9217'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.577633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afc300-f28f-4571-a412-de3d7df5e340 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.580779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260ed4a7ee9e45a7a834d4c56347fdf8', 'request_id': 'req-0427a15c-5315-4929-ad4a-d2d3073b9217'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.596733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1127/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:18.597513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afc300-f28f-4571-a412-de3d7df5e340 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.598020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] The token cache is being invalidate because project 260ed4a7ee9e45a7a834d4c56347fdf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:18.598400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.599190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0427a15c-5315-4929-ad4a-d2d3073b9217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:18.604808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1127/2254] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:18 2022] DELETE /identity/v3/projects/260ed4a7ee9e45a7a834d4c56347fdf8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:18.606307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673dd76-b532-4c8a-a0e4-2f6cabca3f27 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.606771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673dd76-b532-4c8a-a0e4-2f6cabca3f27 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.607150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673dd76-b532-4c8a-a0e4-2f6cabca3f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.615866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afc300-f28f-4571-a412-de3d7df5e340 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.635880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5673dd76-b532-4c8a-a0e4-2f6cabca3f27 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:18.637143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5673dd76-b532-4c8a-a0e4-2f6cabca3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.735886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5048d5-3ded-4b90-bc6d-fa198a1da80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.736678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5048d5-3ded-4b90-bc6d-fa198a1da80e admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.736965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5048d5-3ded-4b90-bc6d-fa198a1da80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.737293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5048d5-3ded-4b90-bc6d-fa198a1da80e admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.738990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5048d5-3ded-4b90-bc6d-fa198a1da80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.740968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5048d5-3ded-4b90-bc6d-fa198a1da80e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.769090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1128/2255] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:18.770901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c8f6-c816-4d95-84e3-468891ca9a37 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.771292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c8f6-c816-4d95-84e3-468891ca9a37 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.771662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c8f6-c816-4d95-84e3-468891ca9a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.806969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3203c8f6-c816-4d95-84e3-468891ca9a37 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:18.811054 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3203c8f6-c816-4d95-84e3-468891ca9a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.811262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1128/2256] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:18.814254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673dd76-b532-4c8a-a0e4-2f6cabca3f27 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.818957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5673dd76-b532-4c8a-a0e4-2f6cabca3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.837648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1129/2257] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:18.838543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203c8f6-c816-4d95-84e3-468891ca9a37 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.860592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203c8f6-c816-4d95-84e3-468891ca9a37 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.864455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673dd76-b532-4c8a-a0e4-2f6cabca3f27 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.879757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c8ba1-e0e7-479a-abc9-53362311164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.880133 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390aa7d-2df5-442e-aca3-b92fabf7a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.880284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8ba1-e0e7-479a-abc9-53362311164c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.880284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8ba1-e0e7-479a-abc9-53362311164c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.880284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8ba1-e0e7-479a-abc9-53362311164c admin admin] PATH_INFO: `/v3/projects/a52b0545eee449e094e1928b27323e1d/users/bff36ec7124a443eae45c3370c7c7b81/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.880553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390aa7d-2df5-442e-aca3-b92fabf7a17a admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.880553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390aa7d-2df5-442e-aca3-b92fabf7a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.880553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390aa7d-2df5-442e-aca3-b92fabf7a17a admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.880553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390aa7d-2df5-442e-aca3-b92fabf7a17a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:18.880553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390aa7d-2df5-442e-aca3-b92fabf7a17a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.886608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390aa7d-2df5-442e-aca3-b92fabf7a17a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.904940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:18.915246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1130/2258] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:18.916345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c8ba1-e0e7-479a-abc9-53362311164c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52b0545eee449e094e1928b27323e1d, user_id=bff36ec7124a443eae45c3370c7c7b81, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.916515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49536-24bd-419d-855d-fb2fcbe9cd79 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.916808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49536-24bd-419d-855d-fb2fcbe9cd79 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.917084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e49536-24bd-419d-855d-fb2fcbe9cd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.923058 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c8ba1-e0e7-479a-abc9-53362311164c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.943665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-d5e49536-24bd-419d-855d-fb2fcbe9cd79 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:18.945061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d5e49536-24bd-419d-855d-fb2fcbe9cd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.953167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1129/2259] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:18 2022] PUT /identity/v3/projects/a52b0545eee449e094e1928b27323e1d/users/bff36ec7124a443eae45c3370c7c7b81/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:18.954408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c8ba1-e0e7-479a-abc9-53362311164c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.024490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:19.043412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1131/2260] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:19.045121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99d19-b175-4e57-b9ff-ffc7a10951bd None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.045464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99d19-b175-4e57-b9ff-ffc7a10951bd None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.045746 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99d19-b175-4e57-b9ff-ffc7a10951bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.052739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c8ba1-e0e7-479a-abc9-53362311164c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.061456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec203f72-49b4-49b5-aac4-0c5db2e47268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.061684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec203f72-49b4-49b5-aac4-0c5db2e47268 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.061952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec203f72-49b4-49b5-aac4-0c5db2e47268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.062299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec203f72-49b4-49b5-aac4-0c5db2e47268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.063048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec203f72-49b4-49b5-aac4-0c5db2e47268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.068555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec203f72-49b4-49b5-aac4-0c5db2e47268 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.082730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-15d99d19-b175-4e57-b9ff-ffc7a10951bd None None] MFA Rules not processed for user `f7c2b0074fb04df5b55bf7363a9e8f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:19.084784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-15d99d19-b175-4e57-b9ff-ffc7a10951bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:19.109662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1130/2261] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:18 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:19.109662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17157b-514b-4561-a9f9-e1167f95aca9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.109662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17157b-514b-4561-a9f9-e1167f95aca9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.109662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17157b-514b-4561-a9f9-e1167f95aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.154326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5f17157b-514b-4561-a9f9-e1167f95aca9 None None] MFA Rules not processed for user `bff36ec7124a443eae45c3370c7c7b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:19.155672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f17157b-514b-4561-a9f9-e1167f95aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:19.182314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1132/2262] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:19.186137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99d19-b175-4e57-b9ff-ffc7a10951bd None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.198698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99d19-b175-4e57-b9ff-ffc7a10951bd None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.279883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1131/2263] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:19.282216 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17157b-514b-4561-a9f9-e1167f95aca9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.313878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.314566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.314681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.314897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.315552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:19.315862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.317496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.331089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1133/2264] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:19.331851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.334280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:19.387791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17157b-514b-4561-a9f9-e1167f95aca9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.399341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413f82-7858-4d57-88d1-cb1f0d2ad181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.400569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413f82-7858-4d57-88d1-cb1f0d2ad181 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.401494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413f82-7858-4d57-88d1-cb1f0d2ad181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.402076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413f82-7858-4d57-88d1-cb1f0d2ad181 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.402945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa413f82-7858-4d57-88d1-cb1f0d2ad181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.405978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa413f82-7858-4d57-88d1-cb1f0d2ad181 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.411846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc1444-9de1-4f6b-899e-633cfe0fe831 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.416328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d566d-cea6-42d8-a4ae-705f29268d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.417180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d566d-cea6-42d8-a4ae-705f29268d06 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.417473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d566d-cea6-42d8-a4ae-705f29268d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.418191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d566d-cea6-42d8-a4ae-705f29268d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.422795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:19.429575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d566d-cea6-42d8-a4ae-705f29268d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.431198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d566d-cea6-42d8-a4ae-705f29268d06 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.442758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1132/2265] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:19 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:19.444650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413f82-7858-4d57-88d1-cb1f0d2ad181 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.452732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1134/2266] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:19.453608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d566d-cea6-42d8-a4ae-705f29268d06 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.463787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413f82-7858-4d57-88d1-cb1f0d2ad181 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.475989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d566d-cea6-42d8-a4ae-705f29268d06 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.485025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcf993-2cda-425d-bd33-f0c67fead18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.485676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf993-2cda-425d-bd33-f0c67fead18a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.486003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf993-2cda-425d-bd33-f0c67fead18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.486281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf993-2cda-425d-bd33-f0c67fead18a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.487010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcf993-2cda-425d-bd33-f0c67fead18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.489250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcf993-2cda-425d-bd33-f0c67fead18a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.504852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d7d6-28b9-401b-8029-eee768491f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.505511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d7d6-28b9-401b-8029-eee768491f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.505791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d7d6-28b9-401b-8029-eee768491f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.506089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d7d6-28b9-401b-8029-eee768491f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.506758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780d7d6-28b9-401b-8029-eee768491f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.508388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780d7d6-28b9-401b-8029-eee768491f35 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.531532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1135/2267] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:19.531532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d7d6-28b9-401b-8029-eee768491f35 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.549050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1133/2268] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:19 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:19.549928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcf993-2cda-425d-bd33-f0c67fead18a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.553101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d7d6-28b9-401b-8029-eee768491f35 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.597631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:19.692901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.693771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.694201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.694632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] PATH_INFO: `/v3/users/bff36ec7124a443eae45c3370c7c7b81` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.695863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff36ec7124a443eae45c3370c7c7b81)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.698301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.701402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcf993-2cda-425d-bd33-f0c67fead18a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.713296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59692f5-b072-413b-b86b-441b77cc8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.713964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59692f5-b072-413b-b86b-441b77cc8b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.714246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59692f5-b072-413b-b86b-441b77cc8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.714518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59692f5-b072-413b-b86b-441b77cc8b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.715164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59692f5-b072-413b-b86b-441b77cc8b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.717600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59692f5-b072-413b-b86b-441b77cc8b39 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.734677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1134/2269] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:19.735661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59692f5-b072-413b-b86b-441b77cc8b39 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.748385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59692f5-b072-413b-b86b-441b77cc8b39 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.754521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.755542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.756010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.756435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.757307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.759583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.804176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff36ec7124a443eae45c3370c7c7b81'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:19.805221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1135/2270] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:19 2022] POST /identity/v3/users => generated 288 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:19.805627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff36ec7124a443eae45c3370c7c7b81'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:19.809815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.812865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:19.824041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff36ec7124a443eae45c3370c7c7b81'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:19.836168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff36ec7124a443eae45c3370c7c7b81'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:19.837961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff36ec7124a443eae45c3370c7c7b81'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:19.843553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4939706-2423-43f4-8b6a-5065f58961a7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:19.853679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5d660-5850-4d74-97e7-64498963f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:19.856578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5d660-5850-4d74-97e7-64498963f12e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.857618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5d660-5850-4d74-97e7-64498963f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.857927 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5d660-5850-4d74-97e7-64498963f12e admin admin] PATH_INFO: `/v3/projects/b306b1d39a4e43ccbf70ca53606c303d/users/f716ed93f77f474e8e2d2810846da22d/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.871205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1136/2271] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:19 2022] DELETE /identity/v3/users/bff36ec7124a443eae45c3370c7c7b81 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:19.871205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:19.871205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:19.914681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5d660-5850-4d74-97e7-64498963f12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b306b1d39a4e43ccbf70ca53606c303d, user_id=f716ed93f77f474e8e2d2810846da22d, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:19.917543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5d660-5850-4d74-97e7-64498963f12e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:19.951391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1136/2272] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:19 2022] PUT /identity/v3/projects/b306b1d39a4e43ccbf70ca53606c303d/users/f716ed93f77f474e8e2d2810846da22d/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:19.953999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8d2f-0b21-4bfb-b9a1-fd56e58e52cd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:19.954513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8d2f-0b21-4bfb-b9a1-fd56e58e52cd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:19.955096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8d2f-0b21-4bfb-b9a1-fd56e58e52cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:19.978695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a24a8d2f-0b21-4bfb-b9a1-fd56e58e52cd None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:19.979997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a24a8d2f-0b21-4bfb-b9a1-fd56e58e52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:20.050062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1137/2273] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:20.051550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd8494-26f1-4826-9ff7-e7569cfd58a6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:20.051898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd8494-26f1-4826-9ff7-e7569cfd58a6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:20.052292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd8494-26f1-4826-9ff7-e7569cfd58a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:20.064370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7971d-8f01-4439-b4bc-615fe8686c68 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:20.083131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:20.085132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:20.085252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:20.085531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:20.090411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:20.092167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:20.100353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-84fd8494-26f1-4826-9ff7-e7569cfd58a6 None None] MFA Rules not processed for user `f716ed93f77f474e8e2d2810846da22d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:20.102309 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84fd8494-26f1-4826-9ff7-e7569cfd58a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:20.121319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1137/2274] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:20.122244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:20.127391 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:20.135404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:20.244299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:20.284887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8b002-f494-4a65-bb10-6fd82de7381c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:20.293291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:20.300004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:20.300389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:20.300675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:20.301525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1138/2275] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:20.302925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd8494-26f1-4826-9ff7-e7569cfd58a6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:20.321382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:20.324292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:20.328949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd8494-26f1-4826-9ff7-e7569cfd58a6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:20.338598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d70d4-2b7c-4044-91aa-2e3eb4b25ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:20.339478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d70d4-2b7c-4044-91aa-2e3eb4b25ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:20.339907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d70d4-2b7c-4044-91aa-2e3eb4b25ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:20.340220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d70d4-2b7c-4044-91aa-2e3eb4b25ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:20.340879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d70d4-2b7c-4044-91aa-2e3eb4b25ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:20.343563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d70d4-2b7c-4044-91aa-2e3eb4b25ad0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:20.350253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1138/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:20.351412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:20.353032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:20.369376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1139/2277] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:20.370305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d70d4-2b7c-4044-91aa-2e3eb4b25ad0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:20.389454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d70d4-2b7c-4044-91aa-2e3eb4b25ad0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:20.403601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6b028-3ef9-40e0-afc4-cc2afd0206ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:20.404443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b028-3ef9-40e0-afc4-cc2afd0206ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:20.405663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b028-3ef9-40e0-afc4-cc2afd0206ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:20.405972 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6b028-3ef9-40e0-afc4-cc2afd0206ca admin admin] PATH_INFO: `/v3/projects/b41d9e3f65e7409a86091e547a89dc4f/users/a8158e7504894fe4879036f7041aeb25/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:20.457708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6b028-3ef9-40e0-afc4-cc2afd0206ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41d9e3f65e7409a86091e547a89dc4f, user_id=a8158e7504894fe4879036f7041aeb25, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:20.462848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6b028-3ef9-40e0-afc4-cc2afd0206ca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:20.464245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38023190-f662-47d1-bfaf-0270a8f4739f service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:20.470609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:20.471944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:20.472691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:20.473337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:20.487787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:20.491081 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:20.497985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1140/2278] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:20 2022] PUT /identity/v3/projects/b41d9e3f65e7409a86091e547a89dc4f/users/a8158e7504894fe4879036f7041aeb25/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:20.501421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942df7dd-5803-4d04-af06-122664237234 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:20.502886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942df7dd-5803-4d04-af06-122664237234 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:20.503187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942df7dd-5803-4d04-af06-122664237234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:20.506884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1139/2279] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:20.578302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-942df7dd-5803-4d04-af06-122664237234 None None] MFA Rules not processed for user `a8158e7504894fe4879036f7041aeb25`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:20.579830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-942df7dd-5803-4d04-af06-122664237234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:20.676470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1141/2280] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:20.695099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:20.698089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:20.738145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0b362-b39f-4684-ab19-7235453443f1 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:20.828701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:20.829570 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:20.829870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:20.830214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:20.858797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:20.860542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:20.885191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1140/2281] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:21.325375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436257-6586-456e-b760-5f6c31390faa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:21.326317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436257-6586-456e-b760-5f6c31390faa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:21.327010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a436257-6586-456e-b760-5f6c31390faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:21.368472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8a436257-6586-456e-b760-5f6c31390faa None None] MFA Rules not processed for user `63c47aa256d542bcbc7fab056615a399`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:21.369701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8a436257-6586-456e-b760-5f6c31390faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:21.478674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1142/2282] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:21.616323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:21.618354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:21.767650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4d1f2-5034-408f-afe4-2db9584c5562 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:21.778023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:21.779845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:21.780291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:21.780934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] PATH_INFO: `/v3/projects/a52b0545eee449e094e1928b27323e1d` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:21.782510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52b0545eee449e094e1928b27323e1d)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:21.798947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:21.849544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:21.871500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52b0545eee449e094e1928b27323e1d', 'request_id': 'req-35de3bb2-2de1-4e0b-b3fc-50195c232beb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:21.880164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52b0545eee449e094e1928b27323e1d', 'request_id': 'req-35de3bb2-2de1-4e0b-b3fc-50195c232beb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:21.890097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52b0545eee449e094e1928b27323e1d', 'request_id': 'req-35de3bb2-2de1-4e0b-b3fc-50195c232beb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:21.907278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] The token cache is being invalidate because project a52b0545eee449e094e1928b27323e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:21.908005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:21.909006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-35de3bb2-2de1-4e0b-b3fc-50195c232beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:21.914211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1141/2283] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:21 2022] DELETE /identity/v3/projects/a52b0545eee449e094e1928b27323e1d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:21.916375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d554c6-e50a-45d0-b1f3-fe37024651d9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:21.916832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d554c6-e50a-45d0-b1f3-fe37024651d9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:21.917267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d554c6-e50a-45d0-b1f3-fe37024651d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:21.944817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-68d554c6-e50a-45d0-b1f3-fe37024651d9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:21.948110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-68d554c6-e50a-45d0-b1f3-fe37024651d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:21.972881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:22.072364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1143/2284] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:22.081790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455305a-5f62-431b-aef6-a5f618635723 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:22.082333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455305a-5f62-431b-aef6-a5f618635723 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:22.083061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455305a-5f62-431b-aef6-a5f618635723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:22.125913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3455305a-5f62-431b-aef6-a5f618635723 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:22.127484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3455305a-5f62-431b-aef6-a5f618635723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:22.141250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1142/2285] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:22.145346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d554c6-e50a-45d0-b1f3-fe37024651d9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:22.164538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d554c6-e50a-45d0-b1f3-fe37024651d9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:22.189413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:22.190097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:22.190383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:22.190664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:22.191405 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:22.191713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:22.193359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:22.237810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1144/2286] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:22.243711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455305a-5f62-431b-aef6-a5f618635723 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:22.262060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455305a-5f62-431b-aef6-a5f618635723 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:22.270483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc454f0c-8463-4c42-8509-3c149c2b8802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:22.271276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454f0c-8463-4c42-8509-3c149c2b8802 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:22.271661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454f0c-8463-4c42-8509-3c149c2b8802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:22.271995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc454f0c-8463-4c42-8509-3c149c2b8802 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:22.272694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc454f0c-8463-4c42-8509-3c149c2b8802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:22.276626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc454f0c-8463-4c42-8509-3c149c2b8802 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:22.327471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1143/2287] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:22 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:22.329149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:22.349441 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7b3cd-a9ce-4bbc-9e67-d07da2323adc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:22.472857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ffb6-6cdc-4d84-93ca-b4cee4f6a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:22.472857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ffb6-6cdc-4d84-93ca-b4cee4f6a0ff admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:22.473244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ffb6-6cdc-4d84-93ca-b4cee4f6a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:22.473418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481ffb6-6cdc-4d84-93ca-b4cee4f6a0ff admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:22.474961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ffb6-6cdc-4d84-93ca-b4cee4f6a0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:22.476913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481ffb6-6cdc-4d84-93ca-b4cee4f6a0ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:22.532640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1145/2288] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:22 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:22.534399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc454f0c-8463-4c42-8509-3c149c2b8802 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:22.563889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc454f0c-8463-4c42-8509-3c149c2b8802 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:22.583842 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3650969-e2f8-4166-af15-01de00e7b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:22.585257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3650969-e2f8-4166-af15-01de00e7b340 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:22.585705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3650969-e2f8-4166-af15-01de00e7b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:22.586189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3650969-e2f8-4166-af15-01de00e7b340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:22.587195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3650969-e2f8-4166-af15-01de00e7b340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:22.588996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3650969-e2f8-4166-af15-01de00e7b340 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:22.611353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1144/2289] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:22.612253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ffb6-6cdc-4d84-93ca-b4cee4f6a0ff admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:22.624674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481ffb6-6cdc-4d84-93ca-b4cee4f6a0ff admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:22.635648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01570fbd-d5c3-4972-9bb0-d05793a7a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:22.636858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01570fbd-d5c3-4972-9bb0-d05793a7a745 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:22.639570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01570fbd-d5c3-4972-9bb0-d05793a7a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:22.641867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01570fbd-d5c3-4972-9bb0-d05793a7a745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:22.643168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01570fbd-d5c3-4972-9bb0-d05793a7a745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:22.650596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01570fbd-d5c3-4972-9bb0-d05793a7a745 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:22.691693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1146/2290] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:22.695919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3650969-e2f8-4166-af15-01de00e7b340 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:22.720575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3650969-e2f8-4166-af15-01de00e7b340 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:22.737320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:22.738288 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:22.738767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:22.739419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] PATH_INFO: `/v3/projects/fb3881530fcf4c0bb477ce102c724555/users/099323741be9414bbd9860d5ec6e90ad/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:22.772932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3881530fcf4c0bb477ce102c724555, user_id=099323741be9414bbd9860d5ec6e90ad, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:22.781135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:22.814633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1145/2291] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:22 2022] PUT /identity/v3/projects/fb3881530fcf4c0bb477ce102c724555/users/099323741be9414bbd9860d5ec6e90ad/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:22.819815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5426e07-9547-489f-aba0-5b0fae473149 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:22.820125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5426e07-9547-489f-aba0-5b0fae473149 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:22.820534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5426e07-9547-489f-aba0-5b0fae473149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:22.849726 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e5426e07-9547-489f-aba0-5b0fae473149 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:22.852978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5426e07-9547-489f-aba0-5b0fae473149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:23.008134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1147/2292] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:23.019340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:23.021890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:23.209386 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb28fa-2334-4086-8c4f-0ebb4174b62b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:23.213665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c8020-9c27-454f-b1ee-a3f86cf5d1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:23.215557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c8020-9c27-454f-b1ee-a3f86cf5d1cb service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:23.215557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c8020-9c27-454f-b1ee-a3f86cf5d1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:23.215557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c8020-9c27-454f-b1ee-a3f86cf5d1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:23.249606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c8020-9c27-454f-b1ee-a3f86cf5d1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:23.253169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c8020-9c27-454f-b1ee-a3f86cf5d1cb service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:23.279377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1146/2293] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:25.041160 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5426e07-9547-489f-aba0-5b0fae473149 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:25.042767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5426e07-9547-489f-aba0-5b0fae473149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:25.060346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5426e07-9547-489f-aba0-5b0fae473149 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:25.067855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:25.067855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:25.068182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:25.068305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] PATH_INFO: `/v3/users/a8158e7504894fe4879036f7041aeb25` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:25.070020 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8158e7504894fe4879036f7041aeb25)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:25.071984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:25.098748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:25.155375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8158e7504894fe4879036f7041aeb25'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:25.156743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8158e7504894fe4879036f7041aeb25'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:25.175885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8158e7504894fe4879036f7041aeb25'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:25.188650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8158e7504894fe4879036f7041aeb25'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:25.188650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8158e7504894fe4879036f7041aeb25'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:25.218719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1148/2294] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:25 2022] DELETE /identity/v3/users/a8158e7504894fe4879036f7041aeb25 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:25.221350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65538-07e6-47f7-a17c-faf92b9db854 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:25.221829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65538-07e6-47f7-a17c-faf92b9db854 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:25.222131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65538-07e6-47f7-a17c-faf92b9db854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:25.245445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-99c65538-07e6-47f7-a17c-faf92b9db854 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:25.246681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-99c65538-07e6-47f7-a17c-faf92b9db854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:25.324173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:25.344963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1147/2295] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:25.360792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:25.363292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:25.468941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d63f-098a-49bc-b69b-ca0c77e3d4c0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:25.477245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6fefb-b4dc-4fab-a4a9-efbf63f3cb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:25.478094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fefb-b4dc-4fab-a4a9-efbf63f3cb20 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:25.479199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fefb-b4dc-4fab-a4a9-efbf63f3cb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:25.479494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fefb-b4dc-4fab-a4a9-efbf63f3cb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:25.521762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6fefb-b4dc-4fab-a4a9-efbf63f3cb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:25.525430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6fefb-b4dc-4fab-a4a9-efbf63f3cb20 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:25.541720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1149/2296] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:26.694156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c65538-07e6-47f7-a17c-faf92b9db854 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:26.696698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-99c65538-07e6-47f7-a17c-faf92b9db854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:26.721056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c65538-07e6-47f7-a17c-faf92b9db854 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:26.729371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:26.730416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:26.730900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:26.732150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] PATH_INFO: `/v3/projects/b41d9e3f65e7409a86091e547a89dc4f` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:26.734377 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41d9e3f65e7409a86091e547a89dc4f)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:26.736526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:26.813009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41d9e3f65e7409a86091e547a89dc4f', 'request_id': 'req-260d73cd-f38f-468d-859d-279655a54d3b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:26.823622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41d9e3f65e7409a86091e547a89dc4f', 'request_id': 'req-260d73cd-f38f-468d-859d-279655a54d3b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:26.839913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41d9e3f65e7409a86091e547a89dc4f', 'request_id': 'req-260d73cd-f38f-468d-859d-279655a54d3b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:26.893149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] The token cache is being invalidate because project b41d9e3f65e7409a86091e547a89dc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:26.893617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:26.894455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-260d73cd-f38f-468d-859d-279655a54d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:26.896319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1148/2297] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:26 2022] DELETE /identity/v3/projects/b41d9e3f65e7409a86091e547a89dc4f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:26.901330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a56dc-1178-4589-a978-11463a830428 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:26.902270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a56dc-1178-4589-a978-11463a830428 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:26.902554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a56dc-1178-4589-a978-11463a830428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:26.944174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7d4a56dc-1178-4589-a978-11463a830428 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:26.945411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7d4a56dc-1178-4589-a978-11463a830428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:27.047026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1150/2298] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:27.055989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6777a03-dca2-419c-b267-dd21a8ef8858 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.056527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6777a03-dca2-419c-b267-dd21a8ef8858 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.057104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6777a03-dca2-419c-b267-dd21a8ef8858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:27.086383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-d6777a03-dca2-419c-b267-dd21a8ef8858 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:27.087614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d6777a03-dca2-419c-b267-dd21a8ef8858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:27.120769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1149/2299] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:27.131033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a56dc-1178-4589-a978-11463a830428 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:27.149561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a56dc-1178-4589-a978-11463a830428 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:27.156357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:27.156983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.157263 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.157539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:27.158306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:27.163098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:27.164760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:27.203060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1151/2300] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:27.207093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6777a03-dca2-419c-b267-dd21a8ef8858 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:27.217245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6777a03-dca2-419c-b267-dd21a8ef8858 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:27.223071 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd8d0c-82b9-4698-8ee4-a1d0db023f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:27.224623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd8d0c-82b9-4698-8ee4-a1d0db023f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.224623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd8d0c-82b9-4698-8ee4-a1d0db023f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.224623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd8d0c-82b9-4698-8ee4-a1d0db023f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:27.225090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd8d0c-82b9-4698-8ee4-a1d0db023f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:27.237015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd8d0c-82b9-4698-8ee4-a1d0db023f66 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:27.276715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1150/2301] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:27 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:27.277368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:27.291223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f920b9e-6f67-4045-bc0c-67fee41b8778 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:27.327376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:27.385730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc440a7-11f0-4be8-b471-96e480516984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:27.386511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc440a7-11f0-4be8-b471-96e480516984 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.386869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc440a7-11f0-4be8-b471-96e480516984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.387155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc440a7-11f0-4be8-b471-96e480516984 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:27.389159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc440a7-11f0-4be8-b471-96e480516984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:27.391320 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc440a7-11f0-4be8-b471-96e480516984 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:27.422472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1152/2302] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:27 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:27.423093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd8d0c-82b9-4698-8ee4-a1d0db023f66 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:27.436496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd8d0c-82b9-4698-8ee4-a1d0db023f66 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:27.442928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039343f-5879-44b6-a81e-c37ea934f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:27.443560 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039343f-5879-44b6-a81e-c37ea934f6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.443842 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039343f-5879-44b6-a81e-c37ea934f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.444116 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039343f-5879-44b6-a81e-c37ea934f6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:27.444779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039343f-5879-44b6-a81e-c37ea934f6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:27.448122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039343f-5879-44b6-a81e-c37ea934f6d7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:27.462959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1151/2303] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:27.467111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc440a7-11f0-4be8-b471-96e480516984 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:27.481200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc440a7-11f0-4be8-b471-96e480516984 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:27.488606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a009a-c7d1-435b-a1e6-574856bd5762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:27.489258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a009a-c7d1-435b-a1e6-574856bd5762 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.490393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a009a-c7d1-435b-a1e6-574856bd5762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.490393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a009a-c7d1-435b-a1e6-574856bd5762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:27.490725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a009a-c7d1-435b-a1e6-574856bd5762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:27.492349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a009a-c7d1-435b-a1e6-574856bd5762 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:27.505900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1153/2304] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:27.509730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039343f-5879-44b6-a81e-c37ea934f6d7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:27.521307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039343f-5879-44b6-a81e-c37ea934f6d7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:27.526846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:27.527524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.527814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.528095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] PATH_INFO: `/v3/projects/3860f87f1b574a6dbb88303cf1a50fd4/users/e953fa83381a4c659a718fa0978eeea6/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:27.547835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3860f87f1b574a6dbb88303cf1a50fd4, user_id=e953fa83381a4c659a718fa0978eeea6, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:27.550682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:27.592853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1152/2305] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:27 2022] PUT /identity/v3/projects/3860f87f1b574a6dbb88303cf1a50fd4/users/e953fa83381a4c659a718fa0978eeea6/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:27.615781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff363e-c467-4b86-8bf9-5617949abc99 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.615781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff363e-c467-4b86-8bf9-5617949abc99 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.615781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff363e-c467-4b86-8bf9-5617949abc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:27.663301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-51ff363e-c467-4b86-8bf9-5617949abc99 None None] MFA Rules not processed for user `e953fa83381a4c659a718fa0978eeea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:27.669630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-51ff363e-c467-4b86-8bf9-5617949abc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:27.808327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1154/2306] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:27.820561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:27.823599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:27.970283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce89ce4-3c6a-4172-aded-0b139e0509bc admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:27.976267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:27.977010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:27.977558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:27.978097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:28.014959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:28.018022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:28.043502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1153/2307] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:31.851838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4f185-abe4-4ca6-8e41-a132c0564c37 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:31.852351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4f185-abe4-4ca6-8e41-a132c0564c37 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:31.852446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4f185-abe4-4ca6-8e41-a132c0564c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:31.892235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-87f4f185-abe4-4ca6-8e41-a132c0564c37 None None] MFA Rules not processed for user `099323741be9414bbd9860d5ec6e90ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:31.894308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-87f4f185-abe4-4ca6-8e41-a132c0564c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:31.995687 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1155/2308] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:32.001993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:32.003463 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:32.056911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:32.112816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e797b97-8ca3-47fb-ac7b-d79acc0efb3d service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:32.117960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3f66-b9b4-431b-9f04-b931b0962890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:32.118593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3f66-b9b4-431b-9f04-b931b0962890 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:32.118885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3f66-b9b4-431b-9f04-b931b0962890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:32.119164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3f66-b9b4-431b-9f04-b931b0962890 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:32.119796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b3f66-b9b4-431b-9f04-b931b0962890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:32.122628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b3f66-b9b4-431b-9f04-b931b0962890 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:32.155645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1154/2309] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:32 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:32.159896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4f185-abe4-4ca6-8e41-a132c0564c37 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:32.171558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4f185-abe4-4ca6-8e41-a132c0564c37 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:32.192129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:32.237055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c033f87-ab45-492a-a8fd-e4e28c94bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:32.238503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033f87-ab45-492a-a8fd-e4e28c94bec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:32.238503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033f87-ab45-492a-a8fd-e4e28c94bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:32.238671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033f87-ab45-492a-a8fd-e4e28c94bec0 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:32.239323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c033f87-ab45-492a-a8fd-e4e28c94bec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:32.242088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c033f87-ab45-492a-a8fd-e4e28c94bec0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:32.265291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1156/2310] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:32 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:32.269281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3f66-b9b4-431b-9f04-b931b0962890 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:32.280623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3f66-b9b4-431b-9f04-b931b0962890 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:32.286752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2187b9f-aa38-448d-9ec8-781970f58237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:32.287513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2187b9f-aa38-448d-9ec8-781970f58237 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:32.287794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2187b9f-aa38-448d-9ec8-781970f58237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:32.288268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2187b9f-aa38-448d-9ec8-781970f58237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:32.288934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2187b9f-aa38-448d-9ec8-781970f58237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:32.290607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2187b9f-aa38-448d-9ec8-781970f58237 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:32.304447 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1155/2311] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:32.308582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c033f87-ab45-492a-a8fd-e4e28c94bec0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:32.320007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c033f87-ab45-492a-a8fd-e4e28c94bec0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:32.325595 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f71f6-15ba-4dbf-acca-f9ac644965f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:32.326742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f71f6-15ba-4dbf-acca-f9ac644965f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:32.327111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f71f6-15ba-4dbf-acca-f9ac644965f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:32.327451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f71f6-15ba-4dbf-acca-f9ac644965f0 admin admin] PATH_INFO: `/v3/projects/2f5fd572613240ca8a1d995bcd022d38/users/ce7d45cdd9d24676972c971e37f378a8/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:32.345011 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f71f6-15ba-4dbf-acca-f9ac644965f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5fd572613240ca8a1d995bcd022d38, user_id=ce7d45cdd9d24676972c971e37f378a8, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:32.347770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f71f6-15ba-4dbf-acca-f9ac644965f0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:32.364785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1157/2312] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:32 2022] PUT /identity/v3/projects/2f5fd572613240ca8a1d995bcd022d38/users/ce7d45cdd9d24676972c971e37f378a8/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:32.368980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2187b9f-aa38-448d-9ec8-781970f58237 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:32.380437 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2187b9f-aa38-448d-9ec8-781970f58237 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:32.455693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:32.456849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:32.457317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:32.457772 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:32.458638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:32.460778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:32.473325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1156/2313] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:32.477410 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f71f6-15ba-4dbf-acca-f9ac644965f0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:32.522842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f71f6-15ba-4dbf-acca-f9ac644965f0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:32.532537 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03a730-3e58-43d1-bd43-3b09891a3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:32.533318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03a730-3e58-43d1-bd43-3b09891a3cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:32.534783 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03a730-3e58-43d1-bd43-3b09891a3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:32.535201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03a730-3e58-43d1-bd43-3b09891a3cfe admin admin] PATH_INFO: `/v3/projects/2f5fd572613240ca8a1d995bcd022d38/users/ce7d45cdd9d24676972c971e37f378a8/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:32.537475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03a730-3e58-43d1-bd43-3b09891a3cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5fd572613240ca8a1d995bcd022d38, user_id=ce7d45cdd9d24676972c971e37f378a8, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:32.540632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03a730-3e58-43d1-bd43-3b09891a3cfe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:32.553463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1158/2314] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:32 2022] PUT /identity/v3/projects/2f5fd572613240ca8a1d995bcd022d38/users/ce7d45cdd9d24676972c971e37f378a8/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:35.769199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:35.773755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:35.827244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f562c7-8dbe-49a5-9fb2-af13040ce680 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:36.139887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:36.140623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:36.140906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:36.141181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] PATH_INFO: `/v3/users/f716ed93f77f474e8e2d2810846da22d` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:36.147433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f716ed93f77f474e8e2d2810846da22d)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:36.154125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:36.251422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:36.284943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f716ed93f77f474e8e2d2810846da22d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.286110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f716ed93f77f474e8e2d2810846da22d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.326563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f716ed93f77f474e8e2d2810846da22d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.350900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f716ed93f77f474e8e2d2810846da22d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.351774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f716ed93f77f474e8e2d2810846da22d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.384396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354cb0-d2b1-42f2-9b3e-565e37016d4f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:36.384968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354cb0-d2b1-42f2-9b3e-565e37016d4f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:36.384968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354cb0-d2b1-42f2-9b3e-565e37016d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:36.388032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1157/2315] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:35 2022] DELETE /identity/v3/users/f716ed93f77f474e8e2d2810846da22d => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:36.415695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-33354cb0-d2b1-42f2-9b3e-565e37016d4f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:36.419411 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-33354cb0-d2b1-42f2-9b3e-565e37016d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:36.641669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1159/2316] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:36.667448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:36.670334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:36.845152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24379d75-4478-4172-8cae-250b06c6a64c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:36.858925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719a97e-37d3-4bfd-ad78-004cee3b1ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:36.860569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a97e-37d3-4bfd-ad78-004cee3b1ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:36.860569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a97e-37d3-4bfd-ad78-004cee3b1ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:36.860569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a97e-37d3-4bfd-ad78-004cee3b1ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:36.886696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719a97e-37d3-4bfd-ad78-004cee3b1ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:36.889522 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719a97e-37d3-4bfd-ad78-004cee3b1ae7 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:36.915183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1158/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:37.849957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33354cb0-d2b1-42f2-9b3e-565e37016d4f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:37.851469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-33354cb0-d2b1-42f2-9b3e-565e37016d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:37.886482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33354cb0-d2b1-42f2-9b3e-565e37016d4f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:37.903693 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:37.904783 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:37.905079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:37.905352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] PATH_INFO: `/v3/projects/b306b1d39a4e43ccbf70ca53606c303d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:37.907924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b306b1d39a4e43ccbf70ca53606c303d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:37.911337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.000641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b306b1d39a4e43ccbf70ca53606c303d', 'request_id': 'req-1dcf24ce-6db0-4597-be14-6824d5cee273'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.036862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b306b1d39a4e43ccbf70ca53606c303d', 'request_id': 'req-1dcf24ce-6db0-4597-be14-6824d5cee273'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.050393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b306b1d39a4e43ccbf70ca53606c303d', 'request_id': 'req-1dcf24ce-6db0-4597-be14-6824d5cee273'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.062974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:38.072751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] The token cache is being invalidate because project b306b1d39a4e43ccbf70ca53606c303d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:38.073425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.075675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1dcf24ce-6db0-4597-be14-6824d5cee273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.078695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1160/2318] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:37 2022] DELETE /identity/v3/projects/b306b1d39a4e43ccbf70ca53606c303d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:38.084521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4f69-f66c-42db-8e46-b7027bfed8d1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.085187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4f69-f66c-42db-8e46-b7027bfed8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.086678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4f69-f66c-42db-8e46-b7027bfed8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.129930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-805b4f69-f66c-42db-8e46-b7027bfed8d1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:38.131188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-805b4f69-f66c-42db-8e46-b7027bfed8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:38.270796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1159/2319] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:38.279023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f15033-c9dd-4e81-80f9-4a86b329beaf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.279447 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f15033-c9dd-4e81-80f9-4a86b329beaf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.279576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f15033-c9dd-4e81-80f9-4a86b329beaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.318699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d8f15033-c9dd-4e81-80f9-4a86b329beaf None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:38.334933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d8f15033-c9dd-4e81-80f9-4a86b329beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:38.371387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1161/2320] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:38.376023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4f69-f66c-42db-8e46-b7027bfed8d1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.390169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4f69-f66c-42db-8e46-b7027bfed8d1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.404249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.405064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.405496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.406118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.406944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:38.407411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.411666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.451919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1160/2321] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:38.456845 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f15033-c9dd-4e81-80f9-4a86b329beaf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.475475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f15033-c9dd-4e81-80f9-4a86b329beaf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.481654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3bbc4-8fea-47d3-83f6-8da272bc49bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.482812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3bbc4-8fea-47d3-83f6-8da272bc49bf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.483219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3bbc4-8fea-47d3-83f6-8da272bc49bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.485804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3bbc4-8fea-47d3-83f6-8da272bc49bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.486685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3bbc4-8fea-47d3-83f6-8da272bc49bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.489782 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3bbc4-8fea-47d3-83f6-8da272bc49bf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.555451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1162/2322] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:38.558240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.573290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59486d0-257c-4440-ac85-279b55c7e3a9 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.679178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:38.735089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c167a-db83-4db5-8228-b11e4f883f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.735808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c167a-db83-4db5-8228-b11e4f883f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.736087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c167a-db83-4db5-8228-b11e4f883f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.736519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c167a-db83-4db5-8228-b11e4f883f2c admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.737156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c167a-db83-4db5-8228-b11e4f883f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.740995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c167a-db83-4db5-8228-b11e4f883f2c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.770830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1161/2323] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:38.775141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3bbc4-8fea-47d3-83f6-8da272bc49bf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.813673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3bbc4-8fea-47d3-83f6-8da272bc49bf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.834208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae0944-12db-4abf-b6d0-1ac0ccd20965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.835111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae0944-12db-4abf-b6d0-1ac0ccd20965 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.836215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae0944-12db-4abf-b6d0-1ac0ccd20965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.837349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae0944-12db-4abf-b6d0-1ac0ccd20965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.837910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae0944-12db-4abf-b6d0-1ac0ccd20965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.839864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae0944-12db-4abf-b6d0-1ac0ccd20965 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.890899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1163/2324] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:38.894827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c167a-db83-4db5-8228-b11e4f883f2c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.908776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c167a-db83-4db5-8228-b11e4f883f2c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.922194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0df7cd-62b3-4a8e-933b-088d77e2f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.923794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0df7cd-62b3-4a8e-933b-088d77e2f2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.923794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0df7cd-62b3-4a8e-933b-088d77e2f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.923794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0df7cd-62b3-4a8e-933b-088d77e2f2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.924154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0df7cd-62b3-4a8e-933b-088d77e2f2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.926053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0df7cd-62b3-4a8e-933b-088d77e2f2b9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.949598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1162/2325] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:38.955978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae0944-12db-4abf-b6d0-1ac0ccd20965 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.970618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae0944-12db-4abf-b6d0-1ac0ccd20965 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.976272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.977065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.977455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.978445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] PATH_INFO: `/v3/projects/423ab37bcbb7402fa3efcae156df8ddd/users/256086f0ff2e4359ad69b02fff6586bd/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.999927 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=423ab37bcbb7402fa3efcae156df8ddd, user_id=256086f0ff2e4359ad69b02fff6586bd, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:39.004048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:39.041937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1164/2326] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:38 2022] PUT /identity/v3/projects/423ab37bcbb7402fa3efcae156df8ddd/users/256086f0ff2e4359ad69b02fff6586bd/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:39.050037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6bf8-e618-41c5-b048-cf7aaed40622 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.050724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6bf8-e618-41c5-b048-cf7aaed40622 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.051183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6bf8-e618-41c5-b048-cf7aaed40622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.107021 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-035a6bf8-e618-41c5-b048-cf7aaed40622 None None] MFA Rules not processed for user `256086f0ff2e4359ad69b02fff6586bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:39.112449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-035a6bf8-e618-41c5-b048-cf7aaed40622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:39.275698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1163/2327] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:39.290665 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:39.293349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:39.408305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4651140-3cff-463b-8619-74252fa36cbb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:39.414481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c16885de9e4e82bcbede361e548ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:39.415163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.415453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.415727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.427659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:39.429130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:39.466930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1165/2328] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:41.372466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36154e0d-57cb-45e7-bf3b-1beea49ad4d4 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:41.373179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36154e0d-57cb-45e7-bf3b-1beea49ad4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:41.373179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36154e0d-57cb-45e7-bf3b-1beea49ad4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:41.409127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-36154e0d-57cb-45e7-bf3b-1beea49ad4d4 None None] MFA Rules not processed for user `ce7d45cdd9d24676972c971e37f378a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:41.410832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-36154e0d-57cb-45e7-bf3b-1beea49ad4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:41.513553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1164/2329] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:41.564322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:41.566341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:41.723674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81dd14-4180-4d71-9a58-6578131e3b55 service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:41.730258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cac07-30f6-4d7d-98fb-93365adce701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:41.731444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cac07-30f6-4d7d-98fb-93365adce701 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:41.732041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cac07-30f6-4d7d-98fb-93365adce701 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:41.732294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cac07-30f6-4d7d-98fb-93365adce701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:41.735104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-679cac07-30f6-4d7d-98fb-93365adce701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:41.808444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:41.868865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cac07-30f6-4d7d-98fb-93365adce701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:41.872736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cac07-30f6-4d7d-98fb-93365adce701 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:41.897935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1166/2330] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:43.853412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c0b3-92ae-4188-a911-3bba72df2b04 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:43.853906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c0b3-92ae-4188-a911-3bba72df2b04 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:43.854022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034c0b3-92ae-4188-a911-3bba72df2b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:43.878165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-d034c0b3-92ae-4188-a911-3bba72df2b04 None None] MFA Rules not processed for user `099323741be9414bbd9860d5ec6e90ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:43.879775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d034c0b3-92ae-4188-a911-3bba72df2b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:43.889567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1165/2331] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:43.919892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265b151-7b36-4d70-888a-dc11114be4ac None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:43.920394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265b151-7b36-4d70-888a-dc11114be4ac None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:43.920489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265b151-7b36-4d70-888a-dc11114be4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:43.943621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2265b151-7b36-4d70-888a-dc11114be4ac None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:43.944854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2265b151-7b36-4d70-888a-dc11114be4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:44.018104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034c0b3-92ae-4188-a911-3bba72df2b04 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:44.019839 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d034c0b3-92ae-4188-a911-3bba72df2b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:44.047940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1167/2332] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:44.099299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:44.115503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265b151-7b36-4d70-888a-dc11114be4ac None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:44.149583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2265b151-7b36-4d70-888a-dc11114be4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:44.194736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034c0b3-92ae-4188-a911-3bba72df2b04 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:44.201531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:44.203496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:44.203925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:44.204215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] PATH_INFO: `/v3/users/65484e81db9d4bb1b83287cfdab28906` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:44.205635 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65484e81db9d4bb1b83287cfdab28906)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:44.208042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:44.250387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265b151-7b36-4d70-888a-dc11114be4ac None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:44.266477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1290eca-fb80-4c0d-b35d-7eea7838f577 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:44.267968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290eca-fb80-4c0d-b35d-7eea7838f577 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:44.268960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290eca-fb80-4c0d-b35d-7eea7838f577 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:44.269554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1290eca-fb80-4c0d-b35d-7eea7838f577 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:44.280270 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1290eca-fb80-4c0d-b35d-7eea7838f577 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:44.286486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1290eca-fb80-4c0d-b35d-7eea7838f577 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:44.292871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65484e81db9d4bb1b83287cfdab28906'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:44.294733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65484e81db9d4bb1b83287cfdab28906'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:44.318841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1168/2333] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:41:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:41:44.326714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65484e81db9d4bb1b83287cfdab28906'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:44.356705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65484e81db9d4bb1b83287cfdab28906'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:44.358305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65484e81db9d4bb1b83287cfdab28906'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:44.378178 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1166/2334] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:44 2022] DELETE /identity/v3/users/65484e81db9d4bb1b83287cfdab28906 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:44.381832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6549-6b7e-480a-94f3-94d6f19bb9ea None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:44.382150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6549-6b7e-480a-94f3-94d6f19bb9ea None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:44.382427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6549-6b7e-480a-94f3-94d6f19bb9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:44.409811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-676a6549-6b7e-480a-94f3-94d6f19bb9ea None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:44.412012 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-676a6549-6b7e-480a-94f3-94d6f19bb9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:44.564092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1169/2335] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:44.579859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:44.582526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:44.682431 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f8bbe-cc38-40ea-8a63-ea9205fab9f2 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:44.693890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52c91d-a820-4fca-bf23-9ee50f89e152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:44.695381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52c91d-a820-4fca-bf23-9ee50f89e152 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:44.695761 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52c91d-a820-4fca-bf23-9ee50f89e152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:44.696137 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52c91d-a820-4fca-bf23-9ee50f89e152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:44.713112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52c91d-a820-4fca-bf23-9ee50f89e152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:44.723799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52c91d-a820-4fca-bf23-9ee50f89e152 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:44.742896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1167/2336] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:45.421033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a6549-6b7e-480a-94f3-94d6f19bb9ea None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:45.423459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-676a6549-6b7e-480a-94f3-94d6f19bb9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:45.454952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a6549-6b7e-480a-94f3-94d6f19bb9ea None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:45.462636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:45.471553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:45.471821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:45.472104 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] PATH_INFO: `/v3/projects/2c0f611fab334b07bc9dd08d3a26ec3f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:45.476048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0f611fab334b07bc9dd08d3a26ec3f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:45.483485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:45.488245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:45.559770 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0f611fab334b07bc9dd08d3a26ec3f', 'request_id': 'req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:45.571829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0f611fab334b07bc9dd08d3a26ec3f', 'request_id': 'req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:45.607671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0f611fab334b07bc9dd08d3a26ec3f', 'request_id': 'req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:45.646494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] The token cache is being invalidate because project 2c0f611fab334b07bc9dd08d3a26ec3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:45.647138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:45.653883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b992b56-f7fd-411f-ae0d-b5e539c2f2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:45.655534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1170/2337] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:45 2022] DELETE /identity/v3/projects/2c0f611fab334b07bc9dd08d3a26ec3f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:45.661369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf5a6-731b-4b6d-b130-c11163bf9200 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:45.661960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf5a6-731b-4b6d-b130-c11163bf9200 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:45.662160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbf5a6-731b-4b6d-b130-c11163bf9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:45.693189 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-27dbf5a6-731b-4b6d-b130-c11163bf9200 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:45.694565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-27dbf5a6-731b-4b6d-b130-c11163bf9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:45.783162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:45.826740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1168/2338] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:45.828544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205ada-62e9-47a3-ad1d-0a63179cf153 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:45.828544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205ada-62e9-47a3-ad1d-0a63179cf153 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:45.828544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205ada-62e9-47a3-ad1d-0a63179cf153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:45.848507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f2205ada-62e9-47a3-ad1d-0a63179cf153 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:45.849742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f2205ada-62e9-47a3-ad1d-0a63179cf153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:45.858753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1171/2339] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:45.863120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbf5a6-731b-4b6d-b130-c11163bf9200 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:45.885975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbf5a6-731b-4b6d-b130-c11163bf9200 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:45.891561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:45.892192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:45.892474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:45.892748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:45.893404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:45.893709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:45.895471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:45.909483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1169/2340] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:45.914234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2205ada-62e9-47a3-ad1d-0a63179cf153 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:45.926196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2205ada-62e9-47a3-ad1d-0a63179cf153 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:45.931201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d210d6-d5f4-4d62-b6b7-0147646a6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:45.931826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d210d6-d5f4-4d62-b6b7-0147646a6ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:45.932095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d210d6-d5f4-4d62-b6b7-0147646a6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:45.932367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d210d6-d5f4-4d62-b6b7-0147646a6ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:45.933285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d210d6-d5f4-4d62-b6b7-0147646a6ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:45.935520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d210d6-d5f4-4d62-b6b7-0147646a6ad3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:45.997800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1172/2341] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:45 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:46.002246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:46.029211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa006046-5622-46f4-b5c0-d98c1c83fb73 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:46.190297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9a243-21c8-4772-86ef-3cf3522adcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:46.191260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a243-21c8-4772-86ef-3cf3522adcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:46.191770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a243-21c8-4772-86ef-3cf3522adcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:46.192254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9a243-21c8-4772-86ef-3cf3522adcd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:46.193098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9a243-21c8-4772-86ef-3cf3522adcd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:46.196083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9a243-21c8-4772-86ef-3cf3522adcd4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:46.238235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d210d6-d5f4-4d62-b6b7-0147646a6ad3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:46.239503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1170/2342] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:46 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:46.254063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d210d6-d5f4-4d62-b6b7-0147646a6ad3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:46.263788 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe197b-ec9f-4da5-b0d8-539eee5faa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:46.265029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe197b-ec9f-4da5-b0d8-539eee5faa92 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:46.265590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe197b-ec9f-4da5-b0d8-539eee5faa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:46.266378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe197b-ec9f-4da5-b0d8-539eee5faa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:46.267653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe197b-ec9f-4da5-b0d8-539eee5faa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:46.269764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe197b-ec9f-4da5-b0d8-539eee5faa92 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:46.313316 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1173/2343] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:46.314089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9a243-21c8-4772-86ef-3cf3522adcd4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:46.329502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9a243-21c8-4772-86ef-3cf3522adcd4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:46.344143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba120f-3fe3-4b98-baf2-8f7e578f95cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:46.345087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba120f-3fe3-4b98-baf2-8f7e578f95cb admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:46.345673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba120f-3fe3-4b98-baf2-8f7e578f95cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:46.346144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba120f-3fe3-4b98-baf2-8f7e578f95cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:46.347184 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba120f-3fe3-4b98-baf2-8f7e578f95cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:46.349091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba120f-3fe3-4b98-baf2-8f7e578f95cb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:46.372875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe197b-ec9f-4da5-b0d8-539eee5faa92 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:46.382355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1171/2344] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:46.385686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe197b-ec9f-4da5-b0d8-539eee5faa92 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:46.392404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:46.394165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:46.394451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:46.395670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] PATH_INFO: `/v3/projects/0c3ee6bf4ca64c0da0f54b4cb00274e2/users/4eeb46d9e5644f71b83f0193dea0d89a/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:46.451061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3ee6bf4ca64c0da0f54b4cb00274e2, user_id=4eeb46d9e5644f71b83f0193dea0d89a, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:46.454912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:46.487140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7fd5-bd43-4c35-a63e-f76ad58af5d8 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:46.487416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7fd5-bd43-4c35-a63e-f76ad58af5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:46.487695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7fd5-bd43-4c35-a63e-f76ad58af5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:46.488967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1174/2345] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:46 2022] PUT /identity/v3/projects/0c3ee6bf4ca64c0da0f54b4cb00274e2/users/4eeb46d9e5644f71b83f0193dea0d89a/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:46.539037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-750c7fd5-bd43-4c35-a63e-f76ad58af5d8 None None] MFA Rules not processed for user `4eeb46d9e5644f71b83f0193dea0d89a`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:46.540710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-750c7fd5-bd43-4c35-a63e-f76ad58af5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:46.660830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1172/2346] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:55.422445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:55.426743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:55.426948 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db0406-fcd1-466b-9e64-67117a934f6c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:55.427403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db0406-fcd1-466b-9e64-67117a934f6c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:55.427495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db0406-fcd1-466b-9e64-67117a934f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:55.460687 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-07db0406-fcd1-466b-9e64-67117a934f6c None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:55.461935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-07db0406-fcd1-466b-9e64-67117a934f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:55.516027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7fdda-623c-4925-a899-635c901ff207 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:55.527870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:55.531506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:55.533062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:55.533347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:55.533733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:55.547626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:55.549097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:55.561807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1175/2347] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:55.566283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1173/2348] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 26 15:41:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:55.583623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:55.588130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:55.645080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:55.704498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105cf3a-e7c5-4013-841a-e4957c686a0c service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:55.710231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e82be-5eb2-44ff-b7c9-70e7b225709f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:55.710841 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e82be-5eb2-44ff-b7c9-70e7b225709f service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:55.711149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e82be-5eb2-44ff-b7c9-70e7b225709f service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:55.712804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e82be-5eb2-44ff-b7c9-70e7b225709f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:55.723935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e82be-5eb2-44ff-b7c9-70e7b225709f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:55.725566 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e82be-5eb2-44ff-b7c9-70e7b225709f service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:55.735061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1176/2349] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:41:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:41:56.053550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ac7ae-3abf-42fc-ade1-964caa1ca59d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:56.053968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ac7ae-3abf-42fc-ade1-964caa1ca59d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:56.054372 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ac7ae-3abf-42fc-ade1-964caa1ca59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:56.077618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-367ac7ae-3abf-42fc-ade1-964caa1ca59d None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:56.079114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-367ac7ae-3abf-42fc-ade1-964caa1ca59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:56.116213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1174/2350] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:56.129112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e82be-5eb2-44ff-b7c9-70e7b225709f service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:56.140974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e82be-5eb2-44ff-b7c9-70e7b225709f service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:56.146041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a682-277f-4a6a-8036-fa2ec88c2595 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:56.146792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a682-277f-4a6a-8036-fa2ec88c2595 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:56.147067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a682-277f-4a6a-8036-fa2ec88c2595 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:56.147339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a682-277f-4a6a-8036-fa2ec88c2595 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:56.156459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a682-277f-4a6a-8036-fa2ec88c2595 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:56.158325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a682-277f-4a6a-8036-fa2ec88c2595 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:56.166768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1177/2351] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:41:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:41:56.511257 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458b89-140e-451a-a6f1-b8250c041ab1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:56.511747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458b89-140e-451a-a6f1-b8250c041ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:56.511859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7458b89-140e-451a-a6f1-b8250c041ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:56.531456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b7458b89-140e-451a-a6f1-b8250c041ab1 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:56.532671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b7458b89-140e-451a-a6f1-b8250c041ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:56.539777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1175/2352] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 26 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:56.552515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a682-277f-4a6a-8036-fa2ec88c2595 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:56.564265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a682-277f-4a6a-8036-fa2ec88c2595 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:56.570475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20b609-7d67-4f92-a4dd-bb9290234983 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:56.570969 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b609-7d67-4f92-a4dd-bb9290234983 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:56.571434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b609-7d67-4f92-a4dd-bb9290234983 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:56.571710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20b609-7d67-4f92-a4dd-bb9290234983 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:56.583707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20b609-7d67-4f92-a4dd-bb9290234983 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:56.585577 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20b609-7d67-4f92-a4dd-bb9290234983 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:56.595533 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1178/2353] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:41:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:41:58.828537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7458b89-140e-451a-a6f1-b8250c041ab1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:58.829970 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b7458b89-140e-451a-a6f1-b8250c041ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:58.900140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7458b89-140e-451a-a6f1-b8250c041ab1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:58.905645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:58.906318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:58.906660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:58.906938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] PATH_INFO: `/v3/users/f7c2b0074fb04df5b55bf7363a9e8f12` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:58.908119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c2b0074fb04df5b55bf7363a9e8f12)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:58.910095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:58.971637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c2b0074fb04df5b55bf7363a9e8f12'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:58.972315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c2b0074fb04df5b55bf7363a9e8f12'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:58.985292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c2b0074fb04df5b55bf7363a9e8f12'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:58.992725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c2b0074fb04df5b55bf7363a9e8f12'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:58.993379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c2b0074fb04df5b55bf7363a9e8f12'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:59.006237 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1176/2354] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:58 2022] DELETE /identity/v3/users/f7c2b0074fb04df5b55bf7363a9e8f12 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:59.010792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719687-c261-4efd-9de5-f9b8330611e0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.011254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719687-c261-4efd-9de5-f9b8330611e0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.011366 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719687-c261-4efd-9de5-f9b8330611e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.030924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-84719687-c261-4efd-9de5-f9b8330611e0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:59.032134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84719687-c261-4efd-9de5-f9b8330611e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:59.094180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1179/2355] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:59.105020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:59.106667 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:59.176835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fb643-292e-4a2d-9c98-31d2932b8584 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:59.180604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10ba96-06f4-4ed2-98c4-2d3b84daa698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:59.181200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ba96-06f4-4ed2-98c4-2d3b84daa698 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.181484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ba96-06f4-4ed2-98c4-2d3b84daa698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.181789 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ba96-06f4-4ed2-98c4-2d3b84daa698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.188982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:59.191682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10ba96-06f4-4ed2-98c4-2d3b84daa698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:59.193726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10ba96-06f4-4ed2-98c4-2d3b84daa698 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:59.205361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1177/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:59.416242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84719687-c261-4efd-9de5-f9b8330611e0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:59.417737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84719687-c261-4efd-9de5-f9b8330611e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:59.434429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84719687-c261-4efd-9de5-f9b8330611e0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:59.455466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:59.456413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.456810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.457266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] PATH_INFO: `/v3/projects/7a38648dbf8b42c48be11c87e6b621b6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.458989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a38648dbf8b42c48be11c87e6b621b6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:59.461532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:59.517992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a38648dbf8b42c48be11c87e6b621b6', 'request_id': 'req-5c9513b0-4308-47c1-8229-27435c9bb8d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:59.532464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a38648dbf8b42c48be11c87e6b621b6', 'request_id': 'req-5c9513b0-4308-47c1-8229-27435c9bb8d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:59.541245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a38648dbf8b42c48be11c87e6b621b6', 'request_id': 'req-5c9513b0-4308-47c1-8229-27435c9bb8d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:59.553092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] The token cache is being invalidate because project 7a38648dbf8b42c48be11c87e6b621b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:59.553466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:59.554763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c9513b0-4308-47c1-8229-27435c9bb8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:59.557021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1180/2357] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:59 2022] DELETE /identity/v3/projects/7a38648dbf8b42c48be11c87e6b621b6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:59.562521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675c6a-1775-4830-a037-cfda54071922 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.563147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675c6a-1775-4830-a037-cfda54071922 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.563898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675c6a-1775-4830-a037-cfda54071922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.598523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e0675c6a-1775-4830-a037-cfda54071922 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:59.600018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e0675c6a-1775-4830-a037-cfda54071922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:59.687815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1178/2358] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:59.695710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe45811-c5c5-4a75-8e08-c9ab7d341166 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.696001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe45811-c5c5-4a75-8e08-c9ab7d341166 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.696278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe45811-c5c5-4a75-8e08-c9ab7d341166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.716920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3fe45811-c5c5-4a75-8e08-c9ab7d341166 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:59.718179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3fe45811-c5c5-4a75-8e08-c9ab7d341166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:59.728197 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1181/2359] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:59.734542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675c6a-1775-4830-a037-cfda54071922 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:59.747956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675c6a-1775-4830-a037-cfda54071922 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:59.753691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:59.754333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.754802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.755171 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.755947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:59.756354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:59.758086 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:59.778206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1179/2360] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:59.781796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe45811-c5c5-4a75-8e08-c9ab7d341166 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:59.791004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe45811-c5c5-4a75-8e08-c9ab7d341166 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:59.797279 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8ced-c0b9-4cba-9897-58c9371cfbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:59.797911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8ced-c0b9-4cba-9897-58c9371cfbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.798193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8ced-c0b9-4cba-9897-58c9371cfbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.798485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da8ced-c0b9-4cba-9897-58c9371cfbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.799107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da8ced-c0b9-4cba-9897-58c9371cfbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:59.801064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da8ced-c0b9-4cba-9897-58c9371cfbb1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:59.811224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:59.831323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1182/2361] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:59 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:59.835715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:59.846308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afb908-df81-4a77-9bb6-e7cd4884e8fe admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:59.906031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fcab2-2960-4c73-a9bd-46f0ae183441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:59.906558 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fcab2-2960-4c73-a9bd-46f0ae183441 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.906980 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fcab2-2960-4c73-a9bd-46f0ae183441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.907104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fcab2-2960-4c73-a9bd-46f0ae183441 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.907741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fcab2-2960-4c73-a9bd-46f0ae183441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:59.909665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fcab2-2960-4c73-a9bd-46f0ae183441 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:59.931979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1180/2362] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:59 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:59.937139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8ced-c0b9-4cba-9897-58c9371cfbb1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:59.948278 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da8ced-c0b9-4cba-9897-58c9371cfbb1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:59.953985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b482d54-93de-49db-81ed-d6c586f13f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:59.954584 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b482d54-93de-49db-81ed-d6c586f13f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.954860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b482d54-93de-49db-81ed-d6c586f13f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.955127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b482d54-93de-49db-81ed-d6c586f13f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:59.955764 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b482d54-93de-49db-81ed-d6c586f13f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:59.957340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b482d54-93de-49db-81ed-d6c586f13f44 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:59.968387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1183/2363] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:59.972621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fcab2-2960-4c73-a9bd-46f0ae183441 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:59.987233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fcab2-2960-4c73-a9bd-46f0ae183441 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:59.996022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc91b4-6b84-44bd-a939-5580a0fff8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:59.996559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc91b4-6b84-44bd-a939-5580a0fff8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:59.996991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc91b4-6b84-44bd-a939-5580a0fff8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:59.999140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc91b4-6b84-44bd-a939-5580a0fff8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:00.000098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc91b4-6b84-44bd-a939-5580a0fff8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:00.001901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc91b4-6b84-44bd-a939-5580a0fff8bf admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:00.014169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1181/2364] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:00.018540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b482d54-93de-49db-81ed-d6c586f13f44 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:00.029158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b482d54-93de-49db-81ed-d6c586f13f44 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:00.046257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:00.047033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:00.047385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:00.047768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] PATH_INFO: `/v3/projects/1ff13adf7d2f41078d2f3d015c2d23e9/users/85b3b9a4ca084c7ca369d2d61f0d18e3/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:00.067078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff13adf7d2f41078d2f3d015c2d23e9, user_id=85b3b9a4ca084c7ca369d2d61f0d18e3, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:00.070068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:00.083889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1184/2365] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:00 2022] PUT /identity/v3/projects/1ff13adf7d2f41078d2f3d015c2d23e9/users/85b3b9a4ca084c7ca369d2d61f0d18e3/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:00.094040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace35e6-2662-4e37-b405-026cd5b04f28 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:00.094496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace35e6-2662-4e37-b405-026cd5b04f28 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:00.094896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace35e6-2662-4e37-b405-026cd5b04f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:00.130548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3ace35e6-2662-4e37-b405-026cd5b04f28 None None] MFA Rules not processed for user `85b3b9a4ca084c7ca369d2d61f0d18e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:00.131839 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3ace35e6-2662-4e37-b405-026cd5b04f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:00.192153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:00.210358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1182/2366] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:00.221758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:00.223581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:00.282574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4690db-8737-468f-b551-51f7cfeca1dd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:00.286420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432b85-667f-4adc-884d-762fceff56cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:00.287082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432b85-667f-4adc-884d-762fceff56cc service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:00.287368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432b85-667f-4adc-884d-762fceff56cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:00.287686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432b85-667f-4adc-884d-762fceff56cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:00.298170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432b85-667f-4adc-884d-762fceff56cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:00.299825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432b85-667f-4adc-884d-762fceff56cc service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:00.310553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1185/2367] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:00.809233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace35e6-2662-4e37-b405-026cd5b04f28 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:00.811315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3ace35e6-2662-4e37-b405-026cd5b04f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:00.887803 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace35e6-2662-4e37-b405-026cd5b04f28 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:00.892808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:00.893432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:00.893711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:00.894053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] PATH_INFO: `/v3/users/4eeb46d9e5644f71b83f0193dea0d89a` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:00.895156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eeb46d9e5644f71b83f0193dea0d89a)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:00.897091 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:00.945862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eeb46d9e5644f71b83f0193dea0d89a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:00.946516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eeb46d9e5644f71b83f0193dea0d89a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:00.959998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eeb46d9e5644f71b83f0193dea0d89a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:00.967817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eeb46d9e5644f71b83f0193dea0d89a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:00.968369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eeb46d9e5644f71b83f0193dea0d89a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:00.980462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1183/2368] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:00 2022] DELETE /identity/v3/users/4eeb46d9e5644f71b83f0193dea0d89a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:00.985681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684923-bf97-4def-905e-8f27aed5d410 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:00.986085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684923-bf97-4def-905e-8f27aed5d410 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:00.986363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684923-bf97-4def-905e-8f27aed5d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:01.007044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a0684923-bf97-4def-905e-8f27aed5d410 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:01.008290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a0684923-bf97-4def-905e-8f27aed5d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:01.066737 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1186/2369] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:01.076606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:01.078103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:01.137261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b450634-ba41-4c11-bea5-4e719e14fe75 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:01.141135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34806dc-3592-4107-8399-1253a226a9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:01.141736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34806dc-3592-4107-8399-1253a226a9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:01.142106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34806dc-3592-4107-8399-1253a226a9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:01.142383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34806dc-3592-4107-8399-1253a226a9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:01.152479 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34806dc-3592-4107-8399-1253a226a9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:01.154494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34806dc-3592-4107-8399-1253a226a9e3 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:01.163757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1184/2370] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:01.471147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684923-bf97-4def-905e-8f27aed5d410 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:01.472707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a0684923-bf97-4def-905e-8f27aed5d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:01.485569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684923-bf97-4def-905e-8f27aed5d410 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:01.491013 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:01.491649 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:01.491932 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:01.492207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] PATH_INFO: `/v3/projects/0c3ee6bf4ca64c0da0f54b4cb00274e2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:01.493363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c3ee6bf4ca64c0da0f54b4cb00274e2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:01.495324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:01.553971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c3ee6bf4ca64c0da0f54b4cb00274e2', 'request_id': 'req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:01.557881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:01.570597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c3ee6bf4ca64c0da0f54b4cb00274e2', 'request_id': 'req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:01.577993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c3ee6bf4ca64c0da0f54b4cb00274e2', 'request_id': 'req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:01.590645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] The token cache is being invalidate because project 0c3ee6bf4ca64c0da0f54b4cb00274e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:01.591010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:01.592297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:01.594033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1187/2371] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:01 2022] DELETE /identity/v3/projects/0c3ee6bf4ca64c0da0f54b4cb00274e2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:02.636539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53dc3-d5fc-4fd8-babb-fe1e7a26eddb None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:02.636989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53dc3-d5fc-4fd8-babb-fe1e7a26eddb None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:02.637125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53dc3-d5fc-4fd8-babb-fe1e7a26eddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:02.658931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e1b53dc3-d5fc-4fd8-babb-fe1e7a26eddb None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:02.660149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e1b53dc3-d5fc-4fd8-babb-fe1e7a26eddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:02.668594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:02.717815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1185/2372] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:02.730174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:02.732175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:02.814208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd37fd-3b69-4d6a-91ed-d48c00465eaa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:02.820089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd8ff-9694-4051-81b4-f468cb6d578b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:02.821021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd8ff-9694-4051-81b4-f468cb6d578b service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:02.821407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd8ff-9694-4051-81b4-f468cb6d578b service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:02.822383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd8ff-9694-4051-81b4-f468cb6d578b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:02.844419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccd8ff-9694-4051-81b4-f468cb6d578b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:02.845539 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccd8ff-9694-4051-81b4-f468cb6d578b service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:02.861207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1188/2373] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:42:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:42:11.350084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b53dc3-d5fc-4fd8-babb-fe1e7a26eddb None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:11.351508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e1b53dc3-d5fc-4fd8-babb-fe1e7a26eddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:11.440531 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b53dc3-d5fc-4fd8-babb-fe1e7a26eddb None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:11.454917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:11.455583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:11.455881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:11.456141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] PATH_INFO: `/v3/users/85b3b9a4ca084c7ca369d2d61f0d18e3` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:11.457290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b3b9a4ca084c7ca369d2d61f0d18e3)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:11.459276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:11.538516 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b3b9a4ca084c7ca369d2d61f0d18e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.539197 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b3b9a4ca084c7ca369d2d61f0d18e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.553267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b3b9a4ca084c7ca369d2d61f0d18e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.564033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b3b9a4ca084c7ca369d2d61f0d18e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.566371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b3b9a4ca084c7ca369d2d61f0d18e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.583976 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1186/2374] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:11 2022] DELETE /identity/v3/users/85b3b9a4ca084c7ca369d2d61f0d18e3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:11.585820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614a158-84c0-4c77-b0a4-5b1690553eba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:11.586396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614a158-84c0-4c77-b0a4-5b1690553eba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:11.586547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614a158-84c0-4c77-b0a4-5b1690553eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:11.627601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0614a158-84c0-4c77-b0a4-5b1690553eba None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:11.632657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0614a158-84c0-4c77-b0a4-5b1690553eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:11.740498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1189/2375] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:11.751336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:11.752843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:11.805191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:11.840017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fdd7e-a474-4bbe-9296-d8a1b1760ade admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:11.844795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:11.845509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:11.845890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:11.846243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:11.856863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:11.858670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:11.872893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1187/2376] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:12.430710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614a158-84c0-4c77-b0a4-5b1690553eba None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:12.432398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0614a158-84c0-4c77-b0a4-5b1690553eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:12.474044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614a158-84c0-4c77-b0a4-5b1690553eba None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:12.484426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:12.485081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:12.485388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:12.486740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] PATH_INFO: `/v3/projects/1ff13adf7d2f41078d2f3d015c2d23e9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:12.488040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff13adf7d2f41078d2f3d015c2d23e9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:12.490082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:12.561868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff13adf7d2f41078d2f3d015c2d23e9', 'request_id': 'req-e3859939-86ab-45f1-96ba-c7da6e66a834'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.572061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff13adf7d2f41078d2f3d015c2d23e9', 'request_id': 'req-e3859939-86ab-45f1-96ba-c7da6e66a834'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.580676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff13adf7d2f41078d2f3d015c2d23e9', 'request_id': 'req-e3859939-86ab-45f1-96ba-c7da6e66a834'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.581902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:12.602253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] The token cache is being invalidate because project 1ff13adf7d2f41078d2f3d015c2d23e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:12.603779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.604664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3859939-86ab-45f1-96ba-c7da6e66a834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.621886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1190/2377] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:12 2022] DELETE /identity/v3/projects/1ff13adf7d2f41078d2f3d015c2d23e9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:16.798020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:16.799418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:16.812045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d98f1-2725-476c-ab2d-9557a512f3f3 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:16.878956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:16.879950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:16.880645 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:16.881104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] PATH_INFO: `/v3/users/256086f0ff2e4359ad69b02fff6586bd` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:16.882900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256086f0ff2e4359ad69b02fff6586bd)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:16.886167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:16.973243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256086f0ff2e4359ad69b02fff6586bd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:16.973963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256086f0ff2e4359ad69b02fff6586bd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:16.988946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256086f0ff2e4359ad69b02fff6586bd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:16.997349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256086f0ff2e4359ad69b02fff6586bd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:16.998731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256086f0ff2e4359ad69b02fff6586bd'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:17.012140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1188/2378] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:16 2022] DELETE /identity/v3/users/256086f0ff2e4359ad69b02fff6586bd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:17.022468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3068-5f1c-4ea5-85fd-16e05e1995f1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.022948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3068-5f1c-4ea5-85fd-16e05e1995f1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.023056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3068-5f1c-4ea5-85fd-16e05e1995f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.043438 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eefc3068-5f1c-4ea5-85fd-16e05e1995f1 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:17.044643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eefc3068-5f1c-4ea5-85fd-16e05e1995f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:17.102705 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1191/2379] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:17.112242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:17.113680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:17.172033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8b3b7-5617-4b55-86e1-32e36b2bc098 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:17.175723 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753734b3-d968-4704-b288-75028fef700d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:17.176326 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753734b3-d968-4704-b288-75028fef700d service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.176609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753734b3-d968-4704-b288-75028fef700d service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.176883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753734b3-d968-4704-b288-75028fef700d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.185776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753734b3-d968-4704-b288-75028fef700d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:17.187245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753734b3-d968-4704-b288-75028fef700d service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:17.196627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1189/2380] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:17.482978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc3068-5f1c-4ea5-85fd-16e05e1995f1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:17.484654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eefc3068-5f1c-4ea5-85fd-16e05e1995f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:17.504459 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc3068-5f1c-4ea5-85fd-16e05e1995f1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:17.508953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:17.509582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.509885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.510167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] PATH_INFO: `/v3/projects/423ab37bcbb7402fa3efcae156df8ddd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.511364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=423ab37bcbb7402fa3efcae156df8ddd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:17.514026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:17.564059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '423ab37bcbb7402fa3efcae156df8ddd', 'request_id': 'req-071024f4-e6b0-42c6-976b-f99b73de5716'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:17.571360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '423ab37bcbb7402fa3efcae156df8ddd', 'request_id': 'req-071024f4-e6b0-42c6-976b-f99b73de5716'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:17.577982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '423ab37bcbb7402fa3efcae156df8ddd', 'request_id': 'req-071024f4-e6b0-42c6-976b-f99b73de5716'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:17.588747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] The token cache is being invalidate because project 423ab37bcbb7402fa3efcae156df8ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:17.589035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:17.589681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-071024f4-e6b0-42c6-976b-f99b73de5716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:17.591246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1192/2381] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:17 2022] DELETE /identity/v3/projects/423ab37bcbb7402fa3efcae156df8ddd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:17.597763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08fe9-1e08-4975-b87c-807c7a14ae59 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.599342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08fe9-1e08-4975-b87c-807c7a14ae59 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.599342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08fe9-1e08-4975-b87c-807c7a14ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.606336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:17.620854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-70c08fe9-1e08-4975-b87c-807c7a14ae59 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:17.623409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-70c08fe9-1e08-4975-b87c-807c7a14ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:17.693622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1190/2382] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:17.701940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b952-1279-40cd-bd01-58a4222f60be None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.702232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b952-1279-40cd-bd01-58a4222f60be None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.702505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7b952-1279-40cd-bd01-58a4222f60be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.723235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9ee7b952-1279-40cd-bd01-58a4222f60be None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:17.724444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ee7b952-1279-40cd-bd01-58a4222f60be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:17.733133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1193/2383] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:17.737331 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c08fe9-1e08-4975-b87c-807c7a14ae59 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:17.748595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c08fe9-1e08-4975-b87c-807c7a14ae59 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:17.753517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:17.754161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.754442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.754730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.755386 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:42:17.755649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:17.757300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:17.773585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1191/2384] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:42:17.774810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7b952-1279-40cd-bd01-58a4222f60be None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:17.784621 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7b952-1279-40cd-bd01-58a4222f60be None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:17.795728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e30da-dd89-4f2b-ab67-179953f2d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:17.796331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e30da-dd89-4f2b-ab67-179953f2d580 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.796607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e30da-dd89-4f2b-ab67-179953f2d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.796879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e30da-dd89-4f2b-ab67-179953f2d580 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.797502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e30da-dd89-4f2b-ab67-179953f2d580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:17.799418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e30da-dd89-4f2b-ab67-179953f2d580 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:17.829574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1194/2385] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:17 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:17.833823 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:17.849066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04a38-3580-47ed-8c19-98631569b075 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:17.913705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c839b3-3e17-435e-8861-1e354fd0afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:17.914375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c839b3-3e17-435e-8861-1e354fd0afdf admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.914663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c839b3-3e17-435e-8861-1e354fd0afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.914963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c839b3-3e17-435e-8861-1e354fd0afdf admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.915591 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c839b3-3e17-435e-8861-1e354fd0afdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:17.917511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c839b3-3e17-435e-8861-1e354fd0afdf admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:17.942934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1192/2386] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:17 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:17.947010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e30da-dd89-4f2b-ab67-179953f2d580 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:17.959148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e30da-dd89-4f2b-ab67-179953f2d580 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:17.965098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee295b94-b125-4883-9f3e-72480152e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:17.965712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee295b94-b125-4883-9f3e-72480152e967 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:17.966068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee295b94-b125-4883-9f3e-72480152e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:17.966382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee295b94-b125-4883-9f3e-72480152e967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:17.967236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee295b94-b125-4883-9f3e-72480152e967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:17.968623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee295b94-b125-4883-9f3e-72480152e967 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:17.985030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1195/2387] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:17.986518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c839b3-3e17-435e-8861-1e354fd0afdf admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:17.999776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c839b3-3e17-435e-8861-1e354fd0afdf admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:18.005786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8eb2f-edc3-4c36-8ada-aa50510525bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:18.006416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8eb2f-edc3-4c36-8ada-aa50510525bd admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:18.006759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8eb2f-edc3-4c36-8ada-aa50510525bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:18.007042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8eb2f-edc3-4c36-8ada-aa50510525bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:18.007697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8eb2f-edc3-4c36-8ada-aa50510525bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:18.018730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8eb2f-edc3-4c36-8ada-aa50510525bd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:18.043282 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1193/2388] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:18.047768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee295b94-b125-4883-9f3e-72480152e967 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:18.058620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee295b94-b125-4883-9f3e-72480152e967 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:18.075710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:18.076699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:18.076982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:18.077262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] PATH_INFO: `/v3/projects/b1f0e31d34214765995684b11dfc727a/users/2b66f912c14c4542a1b9400ec95c97d9/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:18.104630 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f0e31d34214765995684b11dfc727a, user_id=2b66f912c14c4542a1b9400ec95c97d9, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:18.108345 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:18.124381 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1196/2389] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:18 2022] PUT /identity/v3/projects/b1f0e31d34214765995684b11dfc727a/users/2b66f912c14c4542a1b9400ec95c97d9/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:18.131284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754d24-e184-48d7-9628-45ea2caebfeb None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:18.131284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754d24-e184-48d7-9628-45ea2caebfeb None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:18.131548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754d24-e184-48d7-9628-45ea2caebfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:18.160412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3b754d24-e184-48d7-9628-45ea2caebfeb None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:18.161675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3b754d24-e184-48d7-9628-45ea2caebfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:18.253684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1194/2390] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:18.264758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:18.266647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:18.283102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:18.348507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2a7a5-8b18-4803-b81b-36da5262b585 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:18.352328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd17ed2-1db1-461d-92f0-197238bf6036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:18.353044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17ed2-1db1-461d-92f0-197238bf6036 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:18.353199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17ed2-1db1-461d-92f0-197238bf6036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:18.353474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17ed2-1db1-461d-92f0-197238bf6036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:18.363448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17ed2-1db1-461d-92f0-197238bf6036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:18.364887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17ed2-1db1-461d-92f0-197238bf6036 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:18.375750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1197/2391] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:20.603812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d757dce-e8e6-4cd8-a731-e31dd5c87c32 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:20.604358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d757dce-e8e6-4cd8-a731-e31dd5c87c32 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:20.604358 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d757dce-e8e6-4cd8-a731-e31dd5c87c32 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:20.605697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1195/2392] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:42:20.612545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793bcaa-9890-4211-89f9-13b141bfe9ca None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:20.613052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793bcaa-9890-4211-89f9-13b141bfe9ca None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:20.613169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793bcaa-9890-4211-89f9-13b141bfe9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:20.639543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8793bcaa-9890-4211-89f9-13b141bfe9ca None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:20.640755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8793bcaa-9890-4211-89f9-13b141bfe9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:20.751681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1198/2393] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:42:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:20.765374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d757dce-e8e6-4cd8-a731-e31dd5c87c32 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:20.767298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3d757dce-e8e6-4cd8-a731-e31dd5c87c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:20.787073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:20.853051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d757dce-e8e6-4cd8-a731-e31dd5c87c32 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:20.858064 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94665b-e60e-4534-b1e1-a9f024a8fb15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c16885de9e4e82bcbede361e548ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:20.859714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94665b-e60e-4534-b1e1-a9f024a8fb15 service glance] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:20.860200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94665b-e60e-4534-b1e1-a9f024a8fb15 service glance] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:20.860801 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94665b-e60e-4534-b1e1-a9f024a8fb15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:20.875810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94665b-e60e-4534-b1e1-a9f024a8fb15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:20.877697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94665b-e60e-4534-b1e1-a9f024a8fb15 service glance] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:20.902646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1196/2394] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:20.995204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f0021-371b-4a64-9cec-1902797655dc None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:20.995538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f0021-371b-4a64-9cec-1902797655dc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:20.995819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f0021-371b-4a64-9cec-1902797655dc None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:20.997872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1199/2395] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:42:21.003232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7711e-d384-4eca-bdea-69aa89b9de47 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:21.003529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7711e-d384-4eca-bdea-69aa89b9de47 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:21.003811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7711e-d384-4eca-bdea-69aa89b9de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:21.029080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-d8f7711e-d384-4eca-bdea-69aa89b9de47 None None] MFA Rules not processed for user `9962d812513a428b99ada1f79a5b88d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:21.030600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d8f7711e-d384-4eca-bdea-69aa89b9de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:21.038110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1197/2396] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:21.050620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f0021-371b-4a64-9cec-1902797655dc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:21.053119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6f8f0021-371b-4a64-9cec-1902797655dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:21.068034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f0021-371b-4a64-9cec-1902797655dc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:21.072610 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342e96b-167b-44ab-8ee8-e32f286c97a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:21.073378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e96b-167b-44ab-8ee8-e32f286c97a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:21.073661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e96b-167b-44ab-8ee8-e32f286c97a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:21.073970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e96b-167b-44ab-8ee8-e32f286c97a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:21.082555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342e96b-167b-44ab-8ee8-e32f286c97a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:21.084359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342e96b-167b-44ab-8ee8-e32f286c97a3 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:21.096873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1200/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:21.208284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc69b-af72-4ef8-b89f-5f84e4016dff None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:21.208643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc69b-af72-4ef8-b89f-5f84e4016dff None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:21.208835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc69b-af72-4ef8-b89f-5f84e4016dff None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:21.210296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1198/2398] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:42:21.215784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027006b-870d-46de-91f1-521ec1a1edea None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:21.216661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027006b-870d-46de-91f1-521ec1a1edea None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:21.217129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027006b-870d-46de-91f1-521ec1a1edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:21.240887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4027006b-870d-46de-91f1-521ec1a1edea None None] MFA Rules not processed for user `38af4d5f21ae43b699d7890ce9534d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:21.242144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4027006b-870d-46de-91f1-521ec1a1edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:21.265187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1201/2399] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:21.276664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cc69b-af72-4ef8-b89f-5f84e4016dff None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:21.290368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cc69b-af72-4ef8-b89f-5f84e4016dff None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:21.296351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32499b-930b-44c8-b70b-98d39d290b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:21.297107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32499b-930b-44c8-b70b-98d39d290b79 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:21.297940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32499b-930b-44c8-b70b-98d39d290b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:21.298225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32499b-930b-44c8-b70b-98d39d290b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:21.316211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32499b-930b-44c8-b70b-98d39d290b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:21.317741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32499b-930b-44c8-b70b-98d39d290b79 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:21.330284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1199/2400] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:23.234716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027006b-870d-46de-91f1-521ec1a1edea None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:23.237563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4027006b-870d-46de-91f1-521ec1a1edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:23.305605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027006b-870d-46de-91f1-521ec1a1edea None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:23.318842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:23.319956 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:23.321153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:23.322067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] PATH_INFO: `/v3/users/e953fa83381a4c659a718fa0978eeea6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:23.327097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e953fa83381a4c659a718fa0978eeea6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:23.332666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:23.452774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e953fa83381a4c659a718fa0978eeea6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:23.454534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e953fa83381a4c659a718fa0978eeea6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:23.509226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e953fa83381a4c659a718fa0978eeea6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:23.531944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e953fa83381a4c659a718fa0978eeea6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:23.532652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e953fa83381a4c659a718fa0978eeea6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:23.572284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:23.587487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1202/2401] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:23 2022] DELETE /identity/v3/users/e953fa83381a4c659a718fa0978eeea6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:23.593232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f39c-1b6d-4bb4-952f-41d207a5e57b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:23.594868 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f39c-1b6d-4bb4-952f-41d207a5e57b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:23.595520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f39c-1b6d-4bb4-952f-41d207a5e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:23.629263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c0a1f39c-1b6d-4bb4-952f-41d207a5e57b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:23.630718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c0a1f39c-1b6d-4bb4-952f-41d207a5e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:23.775174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1200/2402] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:23.783816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:23.785605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:23.976143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0d4ba-52a4-4775-8896-d06f5c69860d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:23.980784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cb55e-73fc-4fed-b815-50e20a08e7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:23.982018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cb55e-73fc-4fed-b815-50e20a08e7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:23.982407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cb55e-73fc-4fed-b815-50e20a08e7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:23.982803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cb55e-73fc-4fed-b815-50e20a08e7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:23.995708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cb55e-73fc-4fed-b815-50e20a08e7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:23.998038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cb55e-73fc-4fed-b815-50e20a08e7d5 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:24.010472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1203/2403] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:24.425235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f39c-1b6d-4bb4-952f-41d207a5e57b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:24.429350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c0a1f39c-1b6d-4bb4-952f-41d207a5e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:24.472548 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f39c-1b6d-4bb4-952f-41d207a5e57b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:24.482144 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:24.483947 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:24.488401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:24.488401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] PATH_INFO: `/v3/projects/3860f87f1b574a6dbb88303cf1a50fd4` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:24.507401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3860f87f1b574a6dbb88303cf1a50fd4)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:24.510647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:24.641161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3860f87f1b574a6dbb88303cf1a50fd4', 'request_id': 'req-a7f00f60-a248-4ed9-bfb7-264c792de2b6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:24.652188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3860f87f1b574a6dbb88303cf1a50fd4', 'request_id': 'req-a7f00f60-a248-4ed9-bfb7-264c792de2b6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:24.667279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3860f87f1b574a6dbb88303cf1a50fd4', 'request_id': 'req-a7f00f60-a248-4ed9-bfb7-264c792de2b6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:24.684393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] The token cache is being invalidate because project 3860f87f1b574a6dbb88303cf1a50fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:24.684929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:24.686183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:24.688115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1201/2404] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:24 2022] DELETE /identity/v3/projects/3860f87f1b574a6dbb88303cf1a50fd4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:24.884239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd784a-e366-4da4-ace3-a543be35198f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:24.885292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd784a-e366-4da4-ace3-a543be35198f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:24.885769 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd784a-e366-4da4-ace3-a543be35198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:24.929706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-29cd784a-e366-4da4-ace3-a543be35198f None None] MFA Rules not processed for user `2b66f912c14c4542a1b9400ec95c97d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:24.931204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-29cd784a-e366-4da4-ace3-a543be35198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:25.029437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1204/2405] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:25.033653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:25.035146 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:25.066671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:25.153874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f00f60-a248-4ed9-bfb7-264c792de2b6 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:25.159789 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544195-1755-4224-9bbf-16daac3b25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:25.160130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544195-1755-4224-9bbf-16daac3b25c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:25.160422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544195-1755-4224-9bbf-16daac3b25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:25.160700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544195-1755-4224-9bbf-16daac3b25c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:25.161626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f544195-1755-4224-9bbf-16daac3b25c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:25.163731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f544195-1755-4224-9bbf-16daac3b25c4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:25.204795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1202/2406] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:25 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:25.209431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd784a-e366-4da4-ace3-a543be35198f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:25.223466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd784a-e366-4da4-ace3-a543be35198f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:25.301921 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dd7c3-85fd-4ba9-8213-7abd614bc6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:25.302640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dd7c3-85fd-4ba9-8213-7abd614bc6fe admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:25.302989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dd7c3-85fd-4ba9-8213-7abd614bc6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:25.303343 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dd7c3-85fd-4ba9-8213-7abd614bc6fe admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:25.304074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dd7c3-85fd-4ba9-8213-7abd614bc6fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:25.306266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dd7c3-85fd-4ba9-8213-7abd614bc6fe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:25.344171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1205/2407] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:25 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:25.345203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544195-1755-4224-9bbf-16daac3b25c4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:25.359903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544195-1755-4224-9bbf-16daac3b25c4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:25.365468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05953eeb-d251-4936-834b-a560838a5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:25.366140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05953eeb-d251-4936-834b-a560838a5dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:25.366422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05953eeb-d251-4936-834b-a560838a5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:25.366697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05953eeb-d251-4936-834b-a560838a5dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:25.367366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05953eeb-d251-4936-834b-a560838a5dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:25.369019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05953eeb-d251-4936-834b-a560838a5dfc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:25.387484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1203/2408] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:25.390829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dd7c3-85fd-4ba9-8213-7abd614bc6fe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:25.402150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dd7c3-85fd-4ba9-8213-7abd614bc6fe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:25.408585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e88a-3e9c-4a25-8eea-793f87fd57d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:25.409880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e88a-3e9c-4a25-8eea-793f87fd57d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:25.410824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e88a-3e9c-4a25-8eea-793f87fd57d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:25.411341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e88a-3e9c-4a25-8eea-793f87fd57d4 admin admin] PATH_INFO: `/v3/projects/bb16f762b0884967954945df376e90b9/users/8e638e510a0a4944a1543054c8f96c4f/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:25.436706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68e88a-3e9c-4a25-8eea-793f87fd57d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb16f762b0884967954945df376e90b9, user_id=8e638e510a0a4944a1543054c8f96c4f, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:25.440203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68e88a-3e9c-4a25-8eea-793f87fd57d4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:25.451159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:25.462177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1206/2409] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:25 2022] PUT /identity/v3/projects/bb16f762b0884967954945df376e90b9/users/8e638e510a0a4944a1543054c8f96c4f/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:25.464401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05953eeb-d251-4936-834b-a560838a5dfc admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:25.484156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05953eeb-d251-4936-834b-a560838a5dfc admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:25.559374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c33983-2eb6-48cd-b681-1f2b4893347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:25.560660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33983-2eb6-48cd-b681-1f2b4893347d admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:25.560982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33983-2eb6-48cd-b681-1f2b4893347d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:25.561260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33983-2eb6-48cd-b681-1f2b4893347d admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:25.561951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c33983-2eb6-48cd-b681-1f2b4893347d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:25.563978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c33983-2eb6-48cd-b681-1f2b4893347d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:25.575128 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1204/2410] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:25.580236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e88a-3e9c-4a25-8eea-793f87fd57d4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:25.593134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e88a-3e9c-4a25-8eea-793f87fd57d4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:25.600594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:25.601414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:25.601735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:25.602480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] PATH_INFO: `/v3/projects/bb16f762b0884967954945df376e90b9/users/8e638e510a0a4944a1543054c8f96c4f/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:25.604551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb16f762b0884967954945df376e90b9, user_id=8e638e510a0a4944a1543054c8f96c4f, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:25.608397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:25.620557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1207/2411] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:25 2022] PUT /identity/v3/projects/bb16f762b0884967954945df376e90b9/users/8e638e510a0a4944a1543054c8f96c4f/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:26.935163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4fcbc-7af4-44dd-8462-80112976c110 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:26.935636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4fcbc-7af4-44dd-8462-80112976c110 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:26.935740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4fcbc-7af4-44dd-8462-80112976c110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:26.963565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-86a4fcbc-7af4-44dd-8462-80112976c110 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:26.965702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-86a4fcbc-7af4-44dd-8462-80112976c110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:27.077879 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1205/2412] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:27.078677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:27.080683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:27.165024 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392b4aa-43ee-4054-83ca-3dd16f7429a5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:27.171471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9443a1-be9c-4a9a-9473-340b788e27be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:27.172208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9443a1-be9c-4a9a-9473-340b788e27be service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:27.172629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9443a1-be9c-4a9a-9473-340b788e27be service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:27.172981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9443a1-be9c-4a9a-9473-340b788e27be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:27.183125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9443a1-be9c-4a9a-9473-340b788e27be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:27.185816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9443a1-be9c-4a9a-9473-340b788e27be service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:27.195684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1208/2413] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:42:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:42:27.975492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231e0a1-07f5-4e4f-bb8d-ef612f592523 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:27.976030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231e0a1-07f5-4e4f-bb8d-ef612f592523 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:27.976030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231e0a1-07f5-4e4f-bb8d-ef612f592523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:28.033579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e231e0a1-07f5-4e4f-bb8d-ef612f592523 None None] MFA Rules not processed for user `725058b77fb64ed2a8a31869df3d2a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:28.034872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e231e0a1-07f5-4e4f-bb8d-ef612f592523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:28.110595 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:28.211821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1206/2414] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:35.441717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e3215-6d56-4618-998b-ed91969bc5bf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.442826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e3215-6d56-4618-998b-ed91969bc5bf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.443430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e3215-6d56-4618-998b-ed91969bc5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:35.494422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-761e3215-6d56-4618-998b-ed91969bc5bf None None] MFA Rules not processed for user `8e638e510a0a4944a1543054c8f96c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:35.496339 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-761e3215-6d56-4618-998b-ed91969bc5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:35.717894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1209/2415] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:35.755452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231e0a1-07f5-4e4f-bb8d-ef612f592523 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:35.756926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e231e0a1-07f5-4e4f-bb8d-ef612f592523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:35.927592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231e0a1-07f5-4e4f-bb8d-ef612f592523 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:35.935792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a775219-1d34-4816-9055-583596b0c6ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c16885de9e4e82bcbede361e548ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:35.936478 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775219-1d34-4816-9055-583596b0c6ef service glance] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.936982 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775219-1d34-4816-9055-583596b0c6ef service glance] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.938012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775219-1d34-4816-9055-583596b0c6ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:36.069971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a775219-1d34-4816-9055-583596b0c6ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:36.071454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a775219-1d34-4816-9055-583596b0c6ef service glance] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:36.097155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1207/2416] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:36.447513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81988-e4b9-4577-a9e4-59d4d26cb03c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:36.448258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81988-e4b9-4577-a9e4-59d4d26cb03c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:36.448258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81988-e4b9-4577-a9e4-59d4d26cb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:36.524694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1de81988-e4b9-4577-a9e4-59d4d26cb03c None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:36.526765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1de81988-e4b9-4577-a9e4-59d4d26cb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:36.575255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1210/2417] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:36.618115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a775219-1d34-4816-9055-583596b0c6ef service glance] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:36.635346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a775219-1d34-4816-9055-583596b0c6ef service glance] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:36.654524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5e0e9-3b41-432b-8bef-5d8cd4638206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:36.655490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5e0e9-3b41-432b-8bef-5d8cd4638206 service swift] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:36.655924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5e0e9-3b41-432b-8bef-5d8cd4638206 service swift] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:36.656337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5e0e9-3b41-432b-8bef-5d8cd4638206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:36.674893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5e0e9-3b41-432b-8bef-5d8cd4638206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:36.682508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5e0e9-3b41-432b-8bef-5d8cd4638206 service swift] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:36.705185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1208/2418] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:42:41.524419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de81988-e4b9-4577-a9e4-59d4d26cb03c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:41.531141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1de81988-e4b9-4577-a9e4-59d4d26cb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:41.714189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de81988-e4b9-4577-a9e4-59d4d26cb03c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:41.718634 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1b8f9-91be-473e-80c4-bd6934a8beb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:41.719440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b8f9-91be-473e-80c4-bd6934a8beb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:41.719916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b8f9-91be-473e-80c4-bd6934a8beb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:41.720355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b8f9-91be-473e-80c4-bd6934a8beb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:41.722610 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-25f1b8f9-91be-473e-80c4-bd6934a8beb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:41.730262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:41.830393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1b8f9-91be-473e-80c4-bd6934a8beb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:41.834605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1b8f9-91be-473e-80c4-bd6934a8beb8 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:41.876428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1211/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:46.698096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=65 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:49.149898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78946d0-92b8-4722-b0b5-64d34882da8a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:49.150517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78946d0-92b8-4722-b0b5-64d34882da8a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:49.150517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78946d0-92b8-4722-b0b5-64d34882da8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:49.170446 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b78946d0-92b8-4722-b0b5-64d34882da8a None None] MFA Rules not processed for user `2b66f912c14c4542a1b9400ec95c97d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:49.171639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b78946d0-92b8-4722-b0b5-64d34882da8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:49.178379 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1209/2420] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:42:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:50.406805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa71bd-805f-461c-a9d0-8615c1861b90 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:50.407356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa71bd-805f-461c-a9d0-8615c1861b90 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:50.407453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa71bd-805f-461c-a9d0-8615c1861b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:50.426534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a3aa71bd-805f-461c-a9d0-8615c1861b90 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:50.427744 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3aa71bd-805f-461c-a9d0-8615c1861b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:50.436170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1212/2421] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 26 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:50.449292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78946d0-92b8-4722-b0b5-64d34882da8a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:50.464334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78946d0-92b8-4722-b0b5-64d34882da8a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:50.469305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac198ef-58cd-4986-8578-712ee492b6f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:50.469965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac198ef-58cd-4986-8578-712ee492b6f2 service swift] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:50.470229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac198ef-58cd-4986-8578-712ee492b6f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:50.470504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac198ef-58cd-4986-8578-712ee492b6f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:50.478443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac198ef-58cd-4986-8578-712ee492b6f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:50.480030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac198ef-58cd-4986-8578-712ee492b6f2 service swift] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:50.488186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1210/2422] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:42:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:42:53.269274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6adcb9-b52a-4373-9c9e-c2d0683751b3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:53.269755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6adcb9-b52a-4373-9c9e-c2d0683751b3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:53.269929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6adcb9-b52a-4373-9c9e-c2d0683751b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:53.289786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0d6adcb9-b52a-4373-9c9e-c2d0683751b3 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:53.291679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0d6adcb9-b52a-4373-9c9e-c2d0683751b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:53.300647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1213/2423] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:53.317668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac198ef-58cd-4986-8578-712ee492b6f2 service swift] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:53.328926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac198ef-58cd-4986-8578-712ee492b6f2 service swift] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:53.334063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df892f-b9aa-49a2-9361-7eeed593e704 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:53.334878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df892f-b9aa-49a2-9361-7eeed593e704 service swift] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:53.335158 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df892f-b9aa-49a2-9361-7eeed593e704 service swift] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:53.335430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df892f-b9aa-49a2-9361-7eeed593e704 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:53.344863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df892f-b9aa-49a2-9361-7eeed593e704 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:53.346493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df892f-b9aa-49a2-9361-7eeed593e704 service swift] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:53.355334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1211/2424] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:43:03.284929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=32 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:03.351415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=15 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:06.157348 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6adcb9-b52a-4373-9c9e-c2d0683751b3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:06.158948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0d6adcb9-b52a-4373-9c9e-c2d0683751b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.232453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6adcb9-b52a-4373-9c9e-c2d0683751b3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:06.237596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995ae11-1c94-4473-b766-6cf9b4c24d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:06.238240 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995ae11-1c94-4473-b766-6cf9b4c24d08 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:06.238522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995ae11-1c94-4473-b766-6cf9b4c24d08 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:06.238907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995ae11-1c94-4473-b766-6cf9b4c24d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:06.240888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d995ae11-1c94-4473-b766-6cf9b4c24d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.253761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995ae11-1c94-4473-b766-6cf9b4c24d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:06.255402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995ae11-1c94-4473-b766-6cf9b4c24d08 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:06.266062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1214/2425] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:16.261958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=32 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:17.323486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df892f-b9aa-49a2-9361-7eeed593e704 service swift] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:17.333588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df892f-b9aa-49a2-9361-7eeed593e704 service swift] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:17.337167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5a1b7-aef9-4a73-be17-f068733412c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:17.337766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5a1b7-aef9-4a73-be17-f068733412c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:17.338083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5a1b7-aef9-4a73-be17-f068733412c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:17.338355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5a1b7-aef9-4a73-be17-f068733412c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:17.347913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5a1b7-aef9-4a73-be17-f068733412c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:17.349432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5a1b7-aef9-4a73-be17-f068733412c1 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:17.359176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1212/2426] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:27.354650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=6 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:48.632137 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32b5b-1d71-4d9f-9c70-0e632595ede1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:48.632642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32b5b-1d71-4d9f-9c70-0e632595ede1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:48.632739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c32b5b-1d71-4d9f-9c70-0e632595ede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:48.651884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-07c32b5b-1d71-4d9f-9c70-0e632595ede1 None None] MFA Rules not processed for user `59499f8f98f9474c8eda196a712d752e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:48.653690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-07c32b5b-1d71-4d9f-9c70-0e632595ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:48.714832 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1215/2427] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:58.708023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=25 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:05.606917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442da30-c6b4-4da0-ad77-4526c0956827 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:05.607495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442da30-c6b4-4da0-ad77-4526c0956827 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:05.607495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442da30-c6b4-4da0-ad77-4526c0956827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:05.626422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-0442da30-c6b4-4da0-ad77-4526c0956827 None None] MFA Rules not processed for user `725058b77fb64ed2a8a31869df3d2a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:05.627627 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0442da30-c6b4-4da0-ad77-4526c0956827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:05.634493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1213/2428] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:15.621550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:56.289537 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c32b5b-1d71-4d9f-9c70-0e632595ede1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:44:56.291091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-07c32b5b-1d71-4d9f-9c70-0e632595ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:56.406716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c32b5b-1d71-4d9f-9c70-0e632595ede1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:44:56.411635 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:44:56.412259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:56.412534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:56.413048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:56.416233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:56.529571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:44:56.532094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:44:56.544150 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1216/2429] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:44:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:44:57.303460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035b0b0-eba8-4c72-90f8-54a9b78efec1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:57.303979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035b0b0-eba8-4c72-90f8-54a9b78efec1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:57.304066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035b0b0-eba8-4c72-90f8-54a9b78efec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:57.325173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-7035b0b0-eba8-4c72-90f8-54a9b78efec1 None None] MFA Rules not processed for user `63c47aa256d542bcbc7fab056615a399`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:57.326426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-7035b0b0-eba8-4c72-90f8-54a9b78efec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:57.390586 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1214/2430] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:44:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:58.645888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:44:58.655967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97a7f-2743-4868-b37b-7b3be5d30ce1 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:44:58.659567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:44:58.660159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:58.660442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:58.660717 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:58.662867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:58.676096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:44:58.677522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:44:58.688385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1217/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:44:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:03.879999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b72888-d76a-4fbc-b6f0-cb6a9dc5037b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:03.880878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b72888-d76a-4fbc-b6f0-cb6a9dc5037b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:03.881962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b72888-d76a-4fbc-b6f0-cb6a9dc5037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:03.927429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-09b72888-d76a-4fbc-b6f0-cb6a9dc5037b None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:03.928776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-09b72888-d76a-4fbc-b6f0-cb6a9dc5037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:03.938006 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1215/2432] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 26 15:45:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:04.009776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:04.026238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b2d3c-cc10-4450-b48e-b20dd1f30d30 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:04.040243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ada6d9-67c5-4a01-8079-404b395936c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:04.040880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada6d9-67c5-4a01-8079-404b395936c2 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:04.041179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada6d9-67c5-4a01-8079-404b395936c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:04.041486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ada6d9-67c5-4a01-8079-404b395936c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:04.073137 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ada6d9-67c5-4a01-8079-404b395936c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:04.076413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ada6d9-67c5-4a01-8079-404b395936c2 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:04.113245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1218/2433] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:45:08.950321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f0f9-4ed0-4621-bac9-0c421560728c None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:08.950900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f0f9-4ed0-4621-bac9-0c421560728c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:08.950900 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f0f9-4ed0-4621-bac9-0c421560728c None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:08.952259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1216/2434] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 15:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:45:08.979980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48310bdc-54a9-4992-94d4-4a57a399070e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:08.980554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48310bdc-54a9-4992-94d4-4a57a399070e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:08.980659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48310bdc-54a9-4992-94d4-4a57a399070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:09.010999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-48310bdc-54a9-4992-94d4-4a57a399070e None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:09.012482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-48310bdc-54a9-4992-94d4-4a57a399070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:09.035308 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1219/2435] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 15:45:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:45:09.067300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10029-8248-4d62-b500-37ecdd6599f5 None None] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:09.067588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10029-8248-4d62-b500-37ecdd6599f5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:09.067868 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10029-8248-4d62-b500-37ecdd6599f5 None None] PATH_INFO: `/` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:09.069582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1217/2436] 10.222.0.20 () {54 vars in 961 bytes} [Fri Aug 26 15:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:45:09.075338 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408077-b817-4495-a6a8-b77a3ae4352c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:09.075626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408077-b817-4495-a6a8-b77a3ae4352c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:09.075905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22408077-b817-4495-a6a8-b77a3ae4352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:09.098214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-22408077-b817-4495-a6a8-b77a3ae4352c None None] MFA Rules not processed for user `5246da8ac5b943d58b1d565cc4658491`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:09.099855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-22408077-b817-4495-a6a8-b77a3ae4352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:09.110685 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1220/2437] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Aug 26 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:09.119652 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab10029-8248-4d62-b500-37ecdd6599f5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:09.145250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab10029-8248-4d62-b500-37ecdd6599f5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:09.153735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:09.154389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:09.154676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:09.154955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:09.164783 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:09.166819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:09.184936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1218/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:11.947490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22408077-b817-4495-a6a8-b77a3ae4352c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:11.949123 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-22408077-b817-4495-a6a8-b77a3ae4352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:11.982396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22408077-b817-4495-a6a8-b77a3ae4352c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:11.993268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:11.994166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:11.995044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:11.995802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:11.998238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:12.014993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:12.017169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:12.028331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1221/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:13.110504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:13.112113 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:13.130240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed689a1a-4cd5-40f3-9a70-a751cc65c6bb service placement] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:13.137029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:13.138310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:13.138697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:13.139072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:13.141501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:13.219149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:13.220660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:13.232055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1219/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:14.464344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:14.486087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0fc77-40aa-40fb-a328-4107fc3c319d service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:14.496105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:14.497050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:14.498612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:14.499944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] PATH_INFO: `/v3/users/2b66f912c14c4542a1b9400ec95c97d9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:14.501662 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b66f912c14c4542a1b9400ec95c97d9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:14.503925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:14.586346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:14.588741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b66f912c14c4542a1b9400ec95c97d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:14.589599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b66f912c14c4542a1b9400ec95c97d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:14.611435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b66f912c14c4542a1b9400ec95c97d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:14.632716 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b66f912c14c4542a1b9400ec95c97d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:14.633488 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b66f912c14c4542a1b9400ec95c97d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:14.655847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1222/2441] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:45:14 2022] DELETE /identity/v3/users/2b66f912c14c4542a1b9400ec95c97d9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:45:15.300765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:15.317963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e69d4-8f36-4b34-afd4-bc70a07593bf service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:15.391164 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:15.391796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:15.392905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:15.393185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] PATH_INFO: `/v3/projects/b1f0e31d34214765995684b11dfc727a` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:15.394346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f0e31d34214765995684b11dfc727a)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:15.396263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:15.423471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:15.455566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f0e31d34214765995684b11dfc727a', 'request_id': 'req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.464253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f0e31d34214765995684b11dfc727a', 'request_id': 'req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.475094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f0e31d34214765995684b11dfc727a', 'request_id': 'req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.504136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] The token cache is being invalidate because project b1f0e31d34214765995684b11dfc727a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:45:15.504426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.505122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.506878 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1220/2442] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:45:15 2022] DELETE /identity/v3/projects/b1f0e31d34214765995684b11dfc727a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:45:15.511295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:15.512833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:15.527122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489ed0c-e63b-4d63-a837-0e6b936220c2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:15.592664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:15.593077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:15.593597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:15.593597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] PATH_INFO: `/v3/users/8e638e510a0a4944a1543054c8f96c4f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:15.594824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e638e510a0a4944a1543054c8f96c4f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:15.596813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:15.662454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e638e510a0a4944a1543054c8f96c4f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.663131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e638e510a0a4944a1543054c8f96c4f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.677220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e638e510a0a4944a1543054c8f96c4f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.689323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e638e510a0a4944a1543054c8f96c4f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.690437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e638e510a0a4944a1543054c8f96c4f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:15.710255 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1223/2443] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:45:15 2022] DELETE /identity/v3/users/8e638e510a0a4944a1543054c8f96c4f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:45:16.211195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:16.212653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:16.227913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81d21-f2e2-4fc2-af89-a5d7c1e7784e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:16.320159 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:16.321552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:16.323433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:16.323885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] PATH_INFO: `/v3/projects/bb16f762b0884967954945df376e90b9` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:16.326273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb16f762b0884967954945df376e90b9)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:16.328677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:16.398613 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb16f762b0884967954945df376e90b9', 'request_id': 'req-45e26530-47dd-4001-8297-76c894bfa801'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:16.404439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb16f762b0884967954945df376e90b9', 'request_id': 'req-45e26530-47dd-4001-8297-76c894bfa801'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:16.415394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb16f762b0884967954945df376e90b9', 'request_id': 'req-45e26530-47dd-4001-8297-76c894bfa801'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:16.428208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] The token cache is being invalidate because project bb16f762b0884967954945df376e90b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:45:16.428394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:16.429029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:16.446139 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1221/2444] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:45:16 2022] DELETE /identity/v3/projects/bb16f762b0884967954945df376e90b9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:45:18.195117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:18.196710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:18.220399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76cf4-b3fa-4d03-a8f4-722611ff83d5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:18.288261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:18.319568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:18.320738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:18.321099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:18.321464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] PATH_INFO: `/v3/users/725058b77fb64ed2a8a31869df3d2a27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:18.323676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725058b77fb64ed2a8a31869df3d2a27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:18.325712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:18.395919 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725058b77fb64ed2a8a31869df3d2a27'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.396663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725058b77fb64ed2a8a31869df3d2a27'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.411019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725058b77fb64ed2a8a31869df3d2a27'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.420224 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725058b77fb64ed2a8a31869df3d2a27'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.420971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e20e6d55-beff-46f8-9156-63ec6835bcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725058b77fb64ed2a8a31869df3d2a27'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.434342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1224/2445] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:45:18 2022] DELETE /identity/v3/users/725058b77fb64ed2a8a31869df3d2a27 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:45:18.622363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:18.623929 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:18.638922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e26530-47dd-4001-8297-76c894bfa801 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:18.678660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:18.700355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:18.700998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:18.701329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:18.701557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] PATH_INFO: `/v3/projects/7b0253439c5f43b79cb105e2c7a48684` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:18.702891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0253439c5f43b79cb105e2c7a48684)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:18.704856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:18.753894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0253439c5f43b79cb105e2c7a48684', 'request_id': 'req-eb5ef450-09b8-453e-9d22-27320c4f097a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.759710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0253439c5f43b79cb105e2c7a48684', 'request_id': 'req-eb5ef450-09b8-453e-9d22-27320c4f097a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.768173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0253439c5f43b79cb105e2c7a48684', 'request_id': 'req-eb5ef450-09b8-453e-9d22-27320c4f097a'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.779986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] The token cache is being invalidate because project 7b0253439c5f43b79cb105e2c7a48684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:45:18.780856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.781510 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-eb5ef450-09b8-453e-9d22-27320c4f097a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:18.783287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1222/2446] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:45:18 2022] DELETE /identity/v3/projects/7b0253439c5f43b79cb105e2c7a48684 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:45:18.789900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3993-07e5-463a-b72c-1d0b0d988d22 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:18.790198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3993-07e5-463a-b72c-1d0b0d988d22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:18.790551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf3993-07e5-463a-b72c-1d0b0d988d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:18.810760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dadf3993-07e5-463a-b72c-1d0b0d988d22 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:18.812167 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dadf3993-07e5-463a-b72c-1d0b0d988d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:18.877162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1225/2447] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:18.885173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae275ab-6f84-41c7-a92f-1ff5dea9514a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:18.885173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae275ab-6f84-41c7-a92f-1ff5dea9514a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:18.885387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae275ab-6f84-41c7-a92f-1ff5dea9514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:18.908832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-8ae275ab-6f84-41c7-a92f-1ff5dea9514a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:18.910121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-8ae275ab-6f84-41c7-a92f-1ff5dea9514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:18.918457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1223/2448] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:18.923684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf3993-07e5-463a-b72c-1d0b0d988d22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:18.934940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf3993-07e5-463a-b72c-1d0b0d988d22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:18.940575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:18.941207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:18.941489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:18.942027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:18.942692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:45:18.943004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:18.944680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:18.957881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1226/2449] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:45:18.972465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae275ab-6f84-41c7-a92f-1ff5dea9514a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:18.986138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae275ab-6f84-41c7-a92f-1ff5dea9514a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:18.991867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18428-4c52-484e-8624-82df11a6e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:18.992658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18428-4c52-484e-8624-82df11a6e4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:18.992946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18428-4c52-484e-8624-82df11a6e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:18.993219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f18428-4c52-484e-8624-82df11a6e4f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:18.993884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f18428-4c52-484e-8624-82df11a6e4f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:18.995876 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f18428-4c52-484e-8624-82df11a6e4f5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:19.029045 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1224/2450] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:45:18 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:45:19.033596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:19.047580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b1b59-3c72-4770-8a62-473488c9f6fa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:19.115940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:19.158594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697753b3-1795-4596-8c67-be2cf58541ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:19.159335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697753b3-1795-4596-8c67-be2cf58541ca admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:19.160833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697753b3-1795-4596-8c67-be2cf58541ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:19.161446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697753b3-1795-4596-8c67-be2cf58541ca admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:19.163389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697753b3-1795-4596-8c67-be2cf58541ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:19.165609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697753b3-1795-4596-8c67-be2cf58541ca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:19.218562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18428-4c52-484e-8624-82df11a6e4f5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:19.225540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1227/2451] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:45:19 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:45:19.234194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f18428-4c52-484e-8624-82df11a6e4f5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:19.245140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587ed1-9377-4a4e-b150-b47506f0a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:19.246033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587ed1-9377-4a4e-b150-b47506f0a1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:19.246520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587ed1-9377-4a4e-b150-b47506f0a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:19.246993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587ed1-9377-4a4e-b150-b47506f0a1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:19.247893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2587ed1-9377-4a4e-b150-b47506f0a1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:19.250599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2587ed1-9377-4a4e-b150-b47506f0a1b6 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:19.265675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1225/2452] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:45:19.269650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697753b3-1795-4596-8c67-be2cf58541ca admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:19.283867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697753b3-1795-4596-8c67-be2cf58541ca admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:19.291391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c00cd2-f39a-46c1-89a7-9b853e032232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:19.292018 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00cd2-f39a-46c1-89a7-9b853e032232 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:19.292298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00cd2-f39a-46c1-89a7-9b853e032232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:19.292572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00cd2-f39a-46c1-89a7-9b853e032232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:19.293287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c00cd2-f39a-46c1-89a7-9b853e032232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:19.296738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c00cd2-f39a-46c1-89a7-9b853e032232 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:19.314311 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587ed1-9377-4a4e-b150-b47506f0a1b6 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:19.315233 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1228/2453] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:45:19.326378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587ed1-9377-4a4e-b150-b47506f0a1b6 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:19.333249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:19.334292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:19.334724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:19.335172 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] PATH_INFO: `/v3/projects/9f57ba32f438432cad998d0152ebc8bd/users/065f1d6441424ce48ef37c1593ca8d16/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:19.354486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f57ba32f438432cad998d0152ebc8bd, user_id=065f1d6441424ce48ef37c1593ca8d16, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:19.357280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:19.374714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1226/2454] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:45:19 2022] PUT /identity/v3/projects/9f57ba32f438432cad998d0152ebc8bd/users/065f1d6441424ce48ef37c1593ca8d16/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:45:19.379858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c0d9-2810-4142-acbf-2818af3f79bc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:19.380147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c0d9-2810-4142-acbf-2818af3f79bc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:19.380465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5c0d9-2810-4142-acbf-2818af3f79bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:19.400637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1cf5c0d9-2810-4142-acbf-2818af3f79bc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:19.401796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1cf5c0d9-2810-4142-acbf-2818af3f79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:19.474180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1229/2455] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:19.484168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:19.486056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:19.553460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246c18f-23fd-4fa7-b9b9-8b695082707f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:19.557157 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:19.557765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:19.558079 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:19.558355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:19.567643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:19.569072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:19.578933 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1227/2456] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:23.949269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a11dd-b371-48d3-900a-e5d3f88238d6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:23.949776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a11dd-b371-48d3-900a-e5d3f88238d6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:23.949900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a11dd-b371-48d3-900a-e5d3f88238d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:23.984427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7b3a11dd-b371-48d3-900a-e5d3f88238d6 None None] MFA Rules not processed for user `065f1d6441424ce48ef37c1593ca8d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:23.985926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b3a11dd-b371-48d3-900a-e5d3f88238d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:24.071877 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1230/2457] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:24.087294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:24.089181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:24.101973 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:24.205099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6699832-149b-42a6-bc22-57c2fcaa6451 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:24.212937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:24.213699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:24.214011 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:24.214273 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:24.225204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:24.226893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:24.246623 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1228/2458] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:25.618587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fafd-6e44-4021-8456-17fba9e6703c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:25.619205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fafd-6e44-4021-8456-17fba9e6703c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:25.619205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fafd-6e44-4021-8456-17fba9e6703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:25.642268 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e623fafd-6e44-4021-8456-17fba9e6703c None None] MFA Rules not processed for user `065f1d6441424ce48ef37c1593ca8d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:25.643741 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e623fafd-6e44-4021-8456-17fba9e6703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:25.650786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1231/2459] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:45:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:26.206059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:26.207563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:26.222681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d6b89-ab9b-48e6-b034-1eaecbac45d2 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:26.227249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:26.227936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:26.228290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:26.228701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:26.230632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:26.242871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:26.244932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:26.254412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1229/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:26.645469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623fafd-6e44-4021-8456-17fba9e6703c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:26.647695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e623fafd-6e44-4021-8456-17fba9e6703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:26.709508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:26.732461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623fafd-6e44-4021-8456-17fba9e6703c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:26.749943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:26.749943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:26.749943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:26.749943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:26.751131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:26.754996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:26.756723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:26.767137 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1232/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:28.926717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:28.937678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b334d-8987-4acc-816d-3b015d714af3 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:28.941737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b67f-258d-4f2f-abe3-9257ba8cb630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:28.942278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b67f-258d-4f2f-abe3-9257ba8cb630 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:28.942564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b67f-258d-4f2f-abe3-9257ba8cb630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:28.942871 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b67f-258d-4f2f-abe3-9257ba8cb630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:28.948324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c0f9b67f-258d-4f2f-abe3-9257ba8cb630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:28.970010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b67f-258d-4f2f-abe3-9257ba8cb630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:28.971690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b67f-258d-4f2f-abe3-9257ba8cb630 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:28.980817 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1230/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:29.561795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:29.564006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:29.580464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa35c-8ae8-4c2c-98e7-ed91c7f85c7e service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:29.585963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601399-24ac-410b-b846-1234a1532405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:29.586586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601399-24ac-410b-b846-1234a1532405 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:29.586874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601399-24ac-410b-b846-1234a1532405 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:29.587147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601399-24ac-410b-b846-1234a1532405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:29.588886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86601399-24ac-410b-b846-1234a1532405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:29.604050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86601399-24ac-410b-b846-1234a1532405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:29.605871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86601399-24ac-410b-b846-1234a1532405 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:29.619441 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1233/2463] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:45:36.924206 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef18fa-867d-44fe-adfa-7a0cd937b114 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:36.924759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef18fa-867d-44fe-adfa-7a0cd937b114 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:36.924759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef18fa-867d-44fe-adfa-7a0cd937b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:36.946909 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-d3ef18fa-867d-44fe-adfa-7a0cd937b114 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:36.948495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d3ef18fa-867d-44fe-adfa-7a0cd937b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:37.014075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1231/2464] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:37.026587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601399-24ac-410b-b846-1234a1532405 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:37.028010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86601399-24ac-410b-b846-1234a1532405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:37.099638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601399-24ac-410b-b846-1234a1532405 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:37.104767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77148ace-a3bb-4b7a-94be-ccecefe9a476 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:37.105864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77148ace-a3bb-4b7a-94be-ccecefe9a476 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:37.106262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77148ace-a3bb-4b7a-94be-ccecefe9a476 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:37.106611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77148ace-a3bb-4b7a-94be-ccecefe9a476 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:37.115830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77148ace-a3bb-4b7a-94be-ccecefe9a476 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:37.118082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77148ace-a3bb-4b7a-94be-ccecefe9a476 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:37.127861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1234/2465] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:45:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:45:47.007412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=67 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:47.138352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=48 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:48.507511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef18fa-867d-44fe-adfa-7a0cd937b114 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:48.523407 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef18fa-867d-44fe-adfa-7a0cd937b114 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:48.528961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:48.529568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:48.529896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:48.530187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:48.532154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:48.544990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:48.546768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:48.557568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1232/2466] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:52.649667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b98116-a0a7-48cd-a914-4751de739e5f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:52.650190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b98116-a0a7-48cd-a914-4751de739e5f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:52.650291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b98116-a0a7-48cd-a914-4751de739e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:52.669265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-04b98116-a0a7-48cd-a914-4751de739e5f None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:52.670496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-04b98116-a0a7-48cd-a914-4751de739e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:52.678342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1235/2467] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:45:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:52.691018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:52.702336 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb07909-8b15-4447-81ca-a2b57aae6c0f service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:52.707291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb919651-c036-4854-b2c2-d6001e1bc7c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:52.707886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919651-c036-4854-b2c2-d6001e1bc7c9 service swift] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:52.708168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919651-c036-4854-b2c2-d6001e1bc7c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:52.708445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb919651-c036-4854-b2c2-d6001e1bc7c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:52.716426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb919651-c036-4854-b2c2-d6001e1bc7c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:52.718066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb919651-c036-4854-b2c2-d6001e1bc7c9 service swift] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:52.726089 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1233/2468] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:45:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:46:02.664438 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:02.722839 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=12 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:08.464306 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31088b0d-19f0-4d69-b7aa-4b04cadbc5d2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:08.464786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31088b0d-19f0-4d69-b7aa-4b04cadbc5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:08.464908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31088b0d-19f0-4d69-b7aa-4b04cadbc5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:08.485789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-31088b0d-19f0-4d69-b7aa-4b04cadbc5d2 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:08.486946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-31088b0d-19f0-4d69-b7aa-4b04cadbc5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:08.494205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1236/2469] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 26 15:46:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:08.517017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb919651-c036-4854-b2c2-d6001e1bc7c9 service swift] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:08.527459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb919651-c036-4854-b2c2-d6001e1bc7c9 service swift] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:08.532430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cc81-74a0-445d-bec8-7df94f0c5144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:08.533012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cc81-74a0-445d-bec8-7df94f0c5144 service swift] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:08.533290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cc81-74a0-445d-bec8-7df94f0c5144 service swift] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:08.533564 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7cc81-74a0-445d-bec8-7df94f0c5144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:08.541681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7cc81-74a0-445d-bec8-7df94f0c5144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:08.543350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7cc81-74a0-445d-bec8-7df94f0c5144 service swift] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:08.553107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1234/2470] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:46:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:46:18.479344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:18.550605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=6 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:19.024790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31088b0d-19f0-4d69-b7aa-4b04cadbc5d2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.026289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-31088b0d-19f0-4d69-b7aa-4b04cadbc5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:19.086334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31088b0d-19f0-4d69-b7aa-4b04cadbc5d2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.089983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.090585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.090863 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.091134 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.093453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:19.152464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:19.153942 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:19.163420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1237/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:22.709368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cc81-74a0-445d-bec8-7df94f0c5144 service swift] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:22.719643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7cc81-74a0-445d-bec8-7df94f0c5144 service swift] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:22.723205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:22.723788 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:22.724063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:22.724330 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:22.726023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:22.737668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:22.739119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:22.748649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1235/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:25.860301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:25.862022 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:25.879416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538bc91-e53c-4a05-97f5-4e7332f034fb service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:25.884760 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:25.885370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:25.885660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:25.885985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:25.887786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:25.901274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:25.903039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:25.913681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1238/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:46:25.929339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:25.930867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:25.952944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590b75b-fbde-475a-8467-2aa84ffc6752 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:25.957554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:25.958213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:25.958523 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:25.958797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] PATH_INFO: `/v3/users/63c47aa256d542bcbc7fab056615a399` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:25.959908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c47aa256d542bcbc7fab056615a399)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:25.961829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:26.008613 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c47aa256d542bcbc7fab056615a399'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.009254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c47aa256d542bcbc7fab056615a399'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.020920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c47aa256d542bcbc7fab056615a399'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.028052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c47aa256d542bcbc7fab056615a399'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.028758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e19c26ec-df8b-48ed-93b0-675b5cb042fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c47aa256d542bcbc7fab056615a399'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.041366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1236/2474] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:25 2022] DELETE /identity/v3/users/63c47aa256d542bcbc7fab056615a399 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:26.228437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:26.242934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52709e94-2942-48fd-b8a7-3cab5f955d00 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:26.316490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:26.317122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.317514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.317792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] PATH_INFO: `/v3/projects/506e5ae01d6149c5a4a17a64dbfbcd01` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.318939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] RBAC: Authorizing `identity:delete_project(project_id=506e5ae01d6149c5a4a17a64dbfbcd01)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:26.321064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:26.368142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:26.372285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506e5ae01d6149c5a4a17a64dbfbcd01', 'request_id': 'req-5c7435c2-4766-4a04-9bd9-60751f4887af'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.380277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506e5ae01d6149c5a4a17a64dbfbcd01', 'request_id': 'req-5c7435c2-4766-4a04-9bd9-60751f4887af'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.386151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506e5ae01d6149c5a4a17a64dbfbcd01', 'request_id': 'req-5c7435c2-4766-4a04-9bd9-60751f4887af'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.398349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] The token cache is being invalidate because project 506e5ae01d6149c5a4a17a64dbfbcd01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:26.398639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.399288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c7435c2-4766-4a04-9bd9-60751f4887af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:26.400790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1239/2475] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:26 2022] DELETE /identity/v3/projects/506e5ae01d6149c5a4a17a64dbfbcd01 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:26.406968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1eee-7c59-4a50-8d6e-4ad9d0a0061d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.407253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1eee-7c59-4a50-8d6e-4ad9d0a0061d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.407551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be1eee-7c59-4a50-8d6e-4ad9d0a0061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.430042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c0be1eee-7c59-4a50-8d6e-4ad9d0a0061d None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:26.431234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c0be1eee-7c59-4a50-8d6e-4ad9d0a0061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:26.495632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1237/2476] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:26.505470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3fd6c-9397-45ab-9bcc-2bd83e880eb5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.505758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3fd6c-9397-45ab-9bcc-2bd83e880eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.506069 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3fd6c-9397-45ab-9bcc-2bd83e880eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.527599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0ef3fd6c-9397-45ab-9bcc-2bd83e880eb5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:26.528793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ef3fd6c-9397-45ab-9bcc-2bd83e880eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:26.538691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1240/2477] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:26.542281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1eee-7c59-4a50-8d6e-4ad9d0a0061d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:26.552838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be1eee-7c59-4a50-8d6e-4ad9d0a0061d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:26.557397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:26.558024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.558303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.558572 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.559215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:26.559515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:26.561119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:26.578705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1238/2478] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:26.582131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3fd6c-9397-45ab-9bcc-2bd83e880eb5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:26.591715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3fd6c-9397-45ab-9bcc-2bd83e880eb5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:26.597127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d892-d172-41ca-b1f0-d748aa910836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:26.597723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d892-d172-41ca-b1f0-d748aa910836 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.598043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d892-d172-41ca-b1f0-d748aa910836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.598383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d892-d172-41ca-b1f0-d748aa910836 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.599003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2d892-d172-41ca-b1f0-d748aa910836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:26.600873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2d892-d172-41ca-b1f0-d748aa910836 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:26.630358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1241/2479] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:26 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:26.634609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:26.646123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbdc03-1396-4cd6-8834-eb9bc8d8b021 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:26.691056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:26.706027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141310ab-49f2-4343-b2b1-a37f4eadbe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:26.706712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141310ab-49f2-4343-b2b1-a37f4eadbe4f admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.707000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141310ab-49f2-4343-b2b1-a37f4eadbe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.707280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141310ab-49f2-4343-b2b1-a37f4eadbe4f admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.707917 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141310ab-49f2-4343-b2b1-a37f4eadbe4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:26.709831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141310ab-49f2-4343-b2b1-a37f4eadbe4f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:26.731830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1239/2480] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:26 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:26.736830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d892-d172-41ca-b1f0-d748aa910836 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:26.747907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d892-d172-41ca-b1f0-d748aa910836 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:26.752796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8db1f-84ac-4ecc-b5db-092b13081cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:26.753502 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8db1f-84ac-4ecc-b5db-092b13081cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.753857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8db1f-84ac-4ecc-b5db-092b13081cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.754144 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8db1f-84ac-4ecc-b5db-092b13081cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.754983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8db1f-84ac-4ecc-b5db-092b13081cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:26.756625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8db1f-84ac-4ecc-b5db-092b13081cc8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:26.766926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1242/2481] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:26.771295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141310ab-49f2-4343-b2b1-a37f4eadbe4f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:26.783991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141310ab-49f2-4343-b2b1-a37f4eadbe4f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:26.788931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa791ac-76a0-47a9-ac0f-1086d29d7cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:26.789532 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa791ac-76a0-47a9-ac0f-1086d29d7cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.790380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa791ac-76a0-47a9-ac0f-1086d29d7cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.790658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa791ac-76a0-47a9-ac0f-1086d29d7cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.791332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa791ac-76a0-47a9-ac0f-1086d29d7cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:26.792988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa791ac-76a0-47a9-ac0f-1086d29d7cf6 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:26.805473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1240/2482] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:26.809681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8db1f-84ac-4ecc-b5db-092b13081cc8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:26.820751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8db1f-84ac-4ecc-b5db-092b13081cc8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:26.825660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:26.826391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.826633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.826908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] PATH_INFO: `/v3/projects/7f162b5ac7a8454c806791fdd5037a02/users/fb51d86694cf49b1b872d54338dc7012/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.844586 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f162b5ac7a8454c806791fdd5037a02, user_id=fb51d86694cf49b1b872d54338dc7012, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:26.847300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:26.862702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1243/2483] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:26 2022] PUT /identity/v3/projects/7f162b5ac7a8454c806791fdd5037a02/users/fb51d86694cf49b1b872d54338dc7012/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:26.875540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aaac6-fa7d-43f6-b903-db983a2a001a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:26.875765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aaac6-fa7d-43f6-b903-db983a2a001a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:26.876032 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aaac6-fa7d-43f6-b903-db983a2a001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:26.906642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-137aaac6-fa7d-43f6-b903-db983a2a001a None None] MFA Rules not processed for user `fb51d86694cf49b1b872d54338dc7012`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:26.907886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-137aaac6-fa7d-43f6-b903-db983a2a001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:26.974432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1241/2484] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:26.985771 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:26.987642 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:27.063632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231753fc-d122-450b-b5ca-f27a673eaf6f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:27.069273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571e0da-f57f-497e-ba8b-09265b8f103b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:27.069955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e0da-f57f-497e-ba8b-09265b8f103b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:27.070237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e0da-f57f-497e-ba8b-09265b8f103b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:27.070506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e0da-f57f-497e-ba8b-09265b8f103b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:27.079259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571e0da-f57f-497e-ba8b-09265b8f103b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:27.080883 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571e0da-f57f-497e-ba8b-09265b8f103b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:27.089660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1244/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:29.778201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aaac6-fa7d-43f6-b903-db983a2a001a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:29.845427 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aaac6-fa7d-43f6-b903-db983a2a001a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:29.851787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:29.852435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:29.852716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:29.852989 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] PATH_INFO: `/v3/users/fb51d86694cf49b1b872d54338dc7012` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:29.856119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb51d86694cf49b1b872d54338dc7012)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:29.858187 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:29.910991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb51d86694cf49b1b872d54338dc7012'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:29.911927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb51d86694cf49b1b872d54338dc7012'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:29.919284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:29.926468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb51d86694cf49b1b872d54338dc7012'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:29.936303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb51d86694cf49b1b872d54338dc7012'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:29.937344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb51d86694cf49b1b872d54338dc7012'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:29.949553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1242/2486] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:29 2022] DELETE /identity/v3/users/fb51d86694cf49b1b872d54338dc7012 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:29.955189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6431-aa72-4163-8717-b833d937135a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:29.955680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6431-aa72-4163-8717-b833d937135a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:29.955779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6431-aa72-4163-8717-b833d937135a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:29.975303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-368e6431-aa72-4163-8717-b833d937135a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:29.976520 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-368e6431-aa72-4163-8717-b833d937135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:30.024513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:30.039455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1245/2487] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:30.049448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.050934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:30.110048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a993faf-4f91-4b67-9f33-7ec67ea66da7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.113671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.114309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.114594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.114867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.125434 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.126942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.139111 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1243/2488] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:30.317112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485aec6-2665-4c0b-b98e-0f18ac0d8379 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.317489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485aec6-2665-4c0b-b98e-0f18ac0d8379 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.317869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485aec6-2665-4c0b-b98e-0f18ac0d8379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.337259 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5485aec6-2665-4c0b-b98e-0f18ac0d8379 None None] MFA Rules not processed for user `065f1d6441424ce48ef37c1593ca8d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:30.338638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5485aec6-2665-4c0b-b98e-0f18ac0d8379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:30.396372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1246/2489] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:30.423988 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.425622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:30.448239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b0e79-c6e3-445f-b529-cc2de2e983c2 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.455470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.456245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.456588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.456793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] PATH_INFO: `/v3/projects/7f162b5ac7a8454c806791fdd5037a02` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.457960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f162b5ac7a8454c806791fdd5037a02)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.460565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.518198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f162b5ac7a8454c806791fdd5037a02', 'request_id': 'req-a85d0e20-6cfb-4e75-9230-8131c93f2437'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:30.524098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f162b5ac7a8454c806791fdd5037a02', 'request_id': 'req-a85d0e20-6cfb-4e75-9230-8131c93f2437'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:30.531509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f162b5ac7a8454c806791fdd5037a02', 'request_id': 'req-a85d0e20-6cfb-4e75-9230-8131c93f2437'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:30.544026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] The token cache is being invalidate because project 7f162b5ac7a8454c806791fdd5037a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:30.544317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:30.544955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-a85d0e20-6cfb-4e75-9230-8131c93f2437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:30.546546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1244/2490] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:30 2022] DELETE /identity/v3/projects/7f162b5ac7a8454c806791fdd5037a02 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:30.551346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672bbfb-d5aa-4521-90a5-b12db2d5573c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.551671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672bbfb-d5aa-4521-90a5-b12db2d5573c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.551954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672bbfb-d5aa-4521-90a5-b12db2d5573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.573564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f672bbfb-d5aa-4521-90a5-b12db2d5573c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:30.574825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f672bbfb-d5aa-4521-90a5-b12db2d5573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:30.648827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1247/2491] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:30.650315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133550d7-cb77-4686-bfb8-d000be229a24 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.650604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133550d7-cb77-4686-bfb8-d000be229a24 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.650877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133550d7-cb77-4686-bfb8-d000be229a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.671729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-133550d7-cb77-4686-bfb8-d000be229a24 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:30.672931 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-133550d7-cb77-4686-bfb8-d000be229a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:30.681101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1245/2492] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:30.685157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672bbfb-d5aa-4521-90a5-b12db2d5573c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.695702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672bbfb-d5aa-4521-90a5-b12db2d5573c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.700229 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.700835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.701128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.701390 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.702614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:30.702917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.704559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.716148 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1248/2493] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:30.721097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133550d7-cb77-4686-bfb8-d000be229a24 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.730213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133550d7-cb77-4686-bfb8-d000be229a24 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.734901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e0aa6-0c73-4f4b-97f0-6a13cb89e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.735407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.735547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0aa6-0c73-4f4b-97f0-6a13cb89e4ad admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.735762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0aa6-0c73-4f4b-97f0-6a13cb89e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.736039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0aa6-0c73-4f4b-97f0-6a13cb89e4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.736651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e0aa6-0c73-4f4b-97f0-6a13cb89e4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.737385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:30.738590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e0aa6-0c73-4f4b-97f0-6a13cb89e4ad admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.767874 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1246/2494] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:30 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:30.772126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e0aa6-0c73-4f4b-97f0-6a13cb89e4ad admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.800498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a60ed-fff9-4315-8eab-0e5c67d51dd3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.805795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:30.838088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e0aa6-0c73-4f4b-97f0-6a13cb89e4ad admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.841323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:30.845172 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aff981-e57e-412e-996a-04777adcb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.845787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff981-e57e-412e-996a-04777adcb7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.846098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff981-e57e-412e-996a-04777adcb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.846373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff981-e57e-412e-996a-04777adcb7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.847003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aff981-e57e-412e-996a-04777adcb7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.848937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aff981-e57e-412e-996a-04777adcb7ba admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.851888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.852493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.852827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.853101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.854873 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:30.864907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.866664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.870749 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1247/2495] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:30 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:30.875104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aff981-e57e-412e-996a-04777adcb7ba admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.878759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1249/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:46:30.888242 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aff981-e57e-412e-996a-04777adcb7ba admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.893769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e19ec-7cbc-4205-a8fb-4426adf6a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.894417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e19ec-7cbc-4205-a8fb-4426adf6a01e admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.894698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e19ec-7cbc-4205-a8fb-4426adf6a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.894971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e19ec-7cbc-4205-a8fb-4426adf6a01e admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.895617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e19ec-7cbc-4205-a8fb-4426adf6a01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.897318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e19ec-7cbc-4205-a8fb-4426adf6a01e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.908974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1248/2497] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:30.913028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.924513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bca82-164d-4e88-ac3d-5662e11f5777 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.929092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cd074-04e8-4fa4-9c4e-c0490a51fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.929686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cd074-04e8-4fa4-9c4e-c0490a51fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.929994 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cd074-04e8-4fa4-9c4e-c0490a51fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.930267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cd074-04e8-4fa4-9c4e-c0490a51fb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.930904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cd074-04e8-4fa4-9c4e-c0490a51fb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.932526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cd074-04e8-4fa4-9c4e-c0490a51fb8e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.943526 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1250/2498] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:30.947798 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e19ec-7cbc-4205-a8fb-4426adf6a01e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:30.959313 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e19ec-7cbc-4205-a8fb-4426adf6a01e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:30.963996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92d4a3-f78e-41cc-8ac7-e74f9e810670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:30.964630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92d4a3-f78e-41cc-8ac7-e74f9e810670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:30.964910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92d4a3-f78e-41cc-8ac7-e74f9e810670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:30.965186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92d4a3-f78e-41cc-8ac7-e74f9e810670 admin admin] PATH_INFO: `/v3/projects/2aa889a9ffc2488283f2544aa4c27b25/users/04433176912e41dc98a339378ea8c942/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:30.981596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92d4a3-f78e-41cc-8ac7-e74f9e810670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa889a9ffc2488283f2544aa4c27b25, user_id=04433176912e41dc98a339378ea8c942, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:30.985298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92d4a3-f78e-41cc-8ac7-e74f9e810670 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:30.999924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1249/2499] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:30 2022] PUT /identity/v3/projects/2aa889a9ffc2488283f2544aa4c27b25/users/04433176912e41dc98a339378ea8c942/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:31.010445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c60d3d-31bf-4463-8a18-7559d181d776 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.010989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c60d3d-31bf-4463-8a18-7559d181d776 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.011092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c60d3d-31bf-4463-8a18-7559d181d776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.040571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a1c60d3d-31bf-4463-8a18-7559d181d776 None None] MFA Rules not processed for user `04433176912e41dc98a339378ea8c942`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:31.041759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a1c60d3d-31bf-4463-8a18-7559d181d776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:31.116223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1251/2500] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:31.121017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92d4a3-f78e-41cc-8ac7-e74f9e810670 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:31.188397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92d4a3-f78e-41cc-8ac7-e74f9e810670 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:31.193679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f5085-5c02-4981-9a88-762ec21eb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:31.194329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5085-5c02-4981-9a88-762ec21eb2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.194615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5085-5c02-4981-9a88-762ec21eb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.194893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5085-5c02-4981-9a88-762ec21eb2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.195827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f5085-5c02-4981-9a88-762ec21eb2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:31.197755 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f5085-5c02-4981-9a88-762ec21eb2c5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:31.241901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1250/2501] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:31 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:31.245813 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c60d3d-31bf-4463-8a18-7559d181d776 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:31.257943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c60d3d-31bf-4463-8a18-7559d181d776 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:31.323736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9c3a-7252-4bbd-9dab-b9d3aa2a3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:31.324349 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9c3a-7252-4bbd-9dab-b9d3aa2a3cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.324742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9c3a-7252-4bbd-9dab-b9d3aa2a3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.324903 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b9c3a-7252-4bbd-9dab-b9d3aa2a3cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.325559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b9c3a-7252-4bbd-9dab-b9d3aa2a3cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:31.328302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b9c3a-7252-4bbd-9dab-b9d3aa2a3cb8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:31.351663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1252/2502] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:31 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:31.355668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f5085-5c02-4981-9a88-762ec21eb2c5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:31.367199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f5085-5c02-4981-9a88-762ec21eb2c5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:31.371813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818115-5b1d-4543-bb05-ff6887888148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:31.372684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818115-5b1d-4543-bb05-ff6887888148 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.373000 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818115-5b1d-4543-bb05-ff6887888148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.373395 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818115-5b1d-4543-bb05-ff6887888148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.374589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818115-5b1d-4543-bb05-ff6887888148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:31.376401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818115-5b1d-4543-bb05-ff6887888148 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:31.391088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1251/2503] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:31.392801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9c3a-7252-4bbd-9dab-b9d3aa2a3cb8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:31.403417 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b9c3a-7252-4bbd-9dab-b9d3aa2a3cb8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:31.408532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59784bf-1194-46f6-b2ec-ae3086221ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:31.409180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59784bf-1194-46f6-b2ec-ae3086221ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.409455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59784bf-1194-46f6-b2ec-ae3086221ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.409727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59784bf-1194-46f6-b2ec-ae3086221ea3 admin admin] PATH_INFO: `/v3/projects/7f09daf1703b400794b2d39c2263a116/users/89d92f608d8f414e8605921b93ed76d2/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.426938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59784bf-1194-46f6-b2ec-ae3086221ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f09daf1703b400794b2d39c2263a116, user_id=89d92f608d8f414e8605921b93ed76d2, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:31.429592 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59784bf-1194-46f6-b2ec-ae3086221ea3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:31.447294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1253/2504] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:31 2022] PUT /identity/v3/projects/7f09daf1703b400794b2d39c2263a116/users/89d92f608d8f414e8605921b93ed76d2/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:31.451076 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818115-5b1d-4543-bb05-ff6887888148 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:31.461535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818115-5b1d-4543-bb05-ff6887888148 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:31.523214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fed21-52b1-46df-aa0e-40dd574f6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:31.523845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fed21-52b1-46df-aa0e-40dd574f6a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.524126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fed21-52b1-46df-aa0e-40dd574f6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.524404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fed21-52b1-46df-aa0e-40dd574f6a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.525043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fed21-52b1-46df-aa0e-40dd574f6a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:31.526684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fed21-52b1-46df-aa0e-40dd574f6a36 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:31.528053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:31.539597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1252/2505] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:31.543907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59784bf-1194-46f6-b2ec-ae3086221ea3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:31.555575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59784bf-1194-46f6-b2ec-ae3086221ea3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:31.563050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:31.563709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.563994 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.564271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] PATH_INFO: `/v3/projects/7f09daf1703b400794b2d39c2263a116/users/89d92f608d8f414e8605921b93ed76d2/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.566328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f09daf1703b400794b2d39c2263a116, user_id=89d92f608d8f414e8605921b93ed76d2, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:31.569046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:31.580507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1254/2506] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:31 2022] PUT /identity/v3/projects/7f09daf1703b400794b2d39c2263a116/users/89d92f608d8f414e8605921b93ed76d2/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:31.592964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3077c-15a0-4187-a70b-d5a409560a56 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.593229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3077c-15a0-4187-a70b-d5a409560a56 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.593539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3077c-15a0-4187-a70b-d5a409560a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.623526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-13d3077c-15a0-4187-a70b-d5a409560a56 None None] MFA Rules not processed for user `89d92f608d8f414e8605921b93ed76d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:31.625665 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-13d3077c-15a0-4187-a70b-d5a409560a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:31.701551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1253/2507] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:31.712993 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:31.715155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:31.734714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:31.774948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a5422-9285-45b7-bd70-a5aeafe86c93 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:31.778709 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37415c2b-24cc-471f-ae67-04aee789591e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:31.779319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415c2b-24cc-471f-ae67-04aee789591e service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.779601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415c2b-24cc-471f-ae67-04aee789591e service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.779875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415c2b-24cc-471f-ae67-04aee789591e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.789561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37415c2b-24cc-471f-ae67-04aee789591e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:31.791070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37415c2b-24cc-471f-ae67-04aee789591e service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:31.801479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1255/2508] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:32.194416 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3077c-15a0-4187-a70b-d5a409560a56 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:32.258244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3077c-15a0-4187-a70b-d5a409560a56 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:32.262828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:32.263460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:32.263744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:32.264019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] PATH_INFO: `/v3/users/04433176912e41dc98a339378ea8c942` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:32.265298 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04433176912e41dc98a339378ea8c942)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:32.267278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:32.318758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04433176912e41dc98a339378ea8c942'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:32.319838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04433176912e41dc98a339378ea8c942'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:32.334934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04433176912e41dc98a339378ea8c942'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:32.343581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04433176912e41dc98a339378ea8c942'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:32.344511 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04433176912e41dc98a339378ea8c942'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:32.353287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:32.363797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1254/2509] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:32 2022] DELETE /identity/v3/users/04433176912e41dc98a339378ea8c942 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:32.368906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6390e8-915b-49ff-a5cc-c524030ccaa3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:32.369466 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6390e8-915b-49ff-a5cc-c524030ccaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:32.369797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6390e8-915b-49ff-a5cc-c524030ccaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:32.408514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2b6390e8-915b-49ff-a5cc-c524030ccaa3 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:32.409754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b6390e8-915b-49ff-a5cc-c524030ccaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:32.489223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1256/2510] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:32.500514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:32.502072 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:32.573636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eff1c-fe8e-45d2-b1f6-a787e3fcfea5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:32.580318 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796ec03-15b7-4e82-a3c0-54787dca6028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:32.580998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796ec03-15b7-4e82-a3c0-54787dca6028 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:32.581587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796ec03-15b7-4e82-a3c0-54787dca6028 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:32.582015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796ec03-15b7-4e82-a3c0-54787dca6028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:32.591682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796ec03-15b7-4e82-a3c0-54787dca6028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:32.593501 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796ec03-15b7-4e82-a3c0-54787dca6028 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:32.603059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1255/2511] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:33.034008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6390e8-915b-49ff-a5cc-c524030ccaa3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:33.035757 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b6390e8-915b-49ff-a5cc-c524030ccaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:33.059180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6390e8-915b-49ff-a5cc-c524030ccaa3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:33.065190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:33.065960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:33.066318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:33.066602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] PATH_INFO: `/v3/projects/2aa889a9ffc2488283f2544aa4c27b25` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:33.067736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa889a9ffc2488283f2544aa4c27b25)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:33.069652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:33.117047 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa889a9ffc2488283f2544aa4c27b25', 'request_id': 'req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.126361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa889a9ffc2488283f2544aa4c27b25', 'request_id': 'req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.135121 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa889a9ffc2488283f2544aa4c27b25', 'request_id': 'req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.145683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] The token cache is being invalidate because project 2aa889a9ffc2488283f2544aa4c27b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:33.145982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.146648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.148412 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1257/2512] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:33 2022] DELETE /identity/v3/projects/2aa889a9ffc2488283f2544aa4c27b25 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:33.152077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796ec03-15b7-4e82-a3c0-54787dca6028 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:33.162851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796ec03-15b7-4e82-a3c0-54787dca6028 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:33.229471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:33.230182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:33.230182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:33.230182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] PATH_INFO: `/v3/users/89d92f608d8f414e8605921b93ed76d2` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:33.231301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d92f608d8f414e8605921b93ed76d2)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:33.234177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:33.294678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d92f608d8f414e8605921b93ed76d2'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.295359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d92f608d8f414e8605921b93ed76d2'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.315642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d92f608d8f414e8605921b93ed76d2'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.324890 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d92f608d8f414e8605921b93ed76d2'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.325502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-743987ad-5d44-462e-874d-a6aef0f6ac74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d92f608d8f414e8605921b93ed76d2'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.340390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1256/2513] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:33 2022] DELETE /identity/v3/users/89d92f608d8f414e8605921b93ed76d2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:33.643045 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:33.645053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:33.661081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1a5e9-fa0d-4fa1-8590-9cd00daf73f7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:33.727926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:33.747093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:33.747730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:33.747999 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:33.748267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] PATH_INFO: `/v3/projects/7f09daf1703b400794b2d39c2263a116` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:33.750347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f09daf1703b400794b2d39c2263a116)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:33.752262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:33.803738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f09daf1703b400794b2d39c2263a116', 'request_id': 'req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.816152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f09daf1703b400794b2d39c2263a116', 'request_id': 'req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.825626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f09daf1703b400794b2d39c2263a116', 'request_id': 'req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.845683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] The token cache is being invalidate because project 7f09daf1703b400794b2d39c2263a116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:33.846007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.846652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d2734fb-82ec-4af6-93fc-9284dbfa8b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:33.848138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1258/2514] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:33 2022] DELETE /identity/v3/projects/7f09daf1703b400794b2d39c2263a116 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:33.853061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb99dc-4015-401d-9084-0df82f986c8a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:33.853352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb99dc-4015-401d-9084-0df82f986c8a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:33.853634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb99dc-4015-401d-9084-0df82f986c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:33.875083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-65fb99dc-4015-401d-9084-0df82f986c8a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:33.876517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-65fb99dc-4015-401d-9084-0df82f986c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:33.894849 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:33.940726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1257/2515] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:33.948869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3bded-de4c-4c19-a2c7-bebb4531a8df None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:33.949247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3bded-de4c-4c19-a2c7-bebb4531a8df None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:33.949596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3bded-de4c-4c19-a2c7-bebb4531a8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:33.970565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2ed3bded-de4c-4c19-a2c7-bebb4531a8df None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:33.971915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2ed3bded-de4c-4c19-a2c7-bebb4531a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:33.980217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1259/2516] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:33.986099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb99dc-4015-401d-9084-0df82f986c8a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:33.997441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb99dc-4015-401d-9084-0df82f986c8a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.005637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.006456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.006866 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.007143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.007797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:34.008101 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.010239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.023341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1258/2517] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:34.033450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3bded-de4c-4c19-a2c7-bebb4531a8df None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.042810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3bded-de4c-4c19-a2c7-bebb4531a8df None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.050043 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2283-2dbc-438b-ac23-7c72d89537d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.050658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2283-2dbc-438b-ac23-7c72d89537d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.050938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2283-2dbc-438b-ac23-7c72d89537d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.051211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2283-2dbc-438b-ac23-7c72d89537d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.051839 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a2283-2dbc-438b-ac23-7c72d89537d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.053761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a2283-2dbc-438b-ac23-7c72d89537d9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.086532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1260/2518] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:34 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:34.087935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.099552 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b7f1-e389-4748-bcfc-b7810c19382b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.168539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09606fd-f690-4b59-8150-7b024e6406c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.169145 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09606fd-f690-4b59-8150-7b024e6406c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.169426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09606fd-f690-4b59-8150-7b024e6406c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.169698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09606fd-f690-4b59-8150-7b024e6406c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.170356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09606fd-f690-4b59-8150-7b024e6406c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.173180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09606fd-f690-4b59-8150-7b024e6406c4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.198502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1259/2519] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:34 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:34.202645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2283-2dbc-438b-ac23-7c72d89537d9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.213307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2283-2dbc-438b-ac23-7c72d89537d9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.218467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328c8c7-0565-4034-9fe4-a99048dc140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.219168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c8c7-0565-4034-9fe4-a99048dc140c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.219449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c8c7-0565-4034-9fe4-a99048dc140c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.219751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c8c7-0565-4034-9fe4-a99048dc140c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.220419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328c8c7-0565-4034-9fe4-a99048dc140c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.222062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328c8c7-0565-4034-9fe4-a99048dc140c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.232544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1261/2520] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:34.237270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09606fd-f690-4b59-8150-7b024e6406c4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.248060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09606fd-f690-4b59-8150-7b024e6406c4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.253618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0c23-679b-47c2-8858-9a939d0b1446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.254384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0c23-679b-47c2-8858-9a939d0b1446 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.254669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0c23-679b-47c2-8858-9a939d0b1446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.254944 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0c23-679b-47c2-8858-9a939d0b1446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.255589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0c23-679b-47c2-8858-9a939d0b1446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.257211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0c23-679b-47c2-8858-9a939d0b1446 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.271518 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1260/2521] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:34.272742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328c8c7-0565-4034-9fe4-a99048dc140c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.283324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328c8c7-0565-4034-9fe4-a99048dc140c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.288340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524f08f-00f7-478e-9766-1155ef0823f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.288997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524f08f-00f7-478e-9766-1155ef0823f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.289297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524f08f-00f7-478e-9766-1155ef0823f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.289571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524f08f-00f7-478e-9766-1155ef0823f5 admin admin] PATH_INFO: `/v3/projects/3e32779ea1a149ce9c6cf962c4462f7f/users/bb9c324952ae4175a449a7a1222d4bf8/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.305305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524f08f-00f7-478e-9766-1155ef0823f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e32779ea1a149ce9c6cf962c4462f7f, user_id=bb9c324952ae4175a449a7a1222d4bf8, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.307982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524f08f-00f7-478e-9766-1155ef0823f5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.321562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1262/2522] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:34 2022] PUT /identity/v3/projects/3e32779ea1a149ce9c6cf962c4462f7f/users/bb9c324952ae4175a449a7a1222d4bf8/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:34.333132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef92a-efa6-4871-981b-3b5e30cefc51 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.333424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef92a-efa6-4871-981b-3b5e30cefc51 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.333707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef92a-efa6-4871-981b-3b5e30cefc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.363260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e38ef92a-efa6-4871-981b-3b5e30cefc51 None None] MFA Rules not processed for user `bb9c324952ae4175a449a7a1222d4bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:34.364484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e38ef92a-efa6-4871-981b-3b5e30cefc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:34.431992 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1261/2523] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:34.436789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524f08f-00f7-478e-9766-1155ef0823f5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.505660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524f08f-00f7-478e-9766-1155ef0823f5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.510353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f779d-afc3-418f-a03d-26e066d61719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.510964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f779d-afc3-418f-a03d-26e066d61719 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.511241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f779d-afc3-418f-a03d-26e066d61719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.511508 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f779d-afc3-418f-a03d-26e066d61719 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.512124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f779d-afc3-418f-a03d-26e066d61719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.514073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f779d-afc3-418f-a03d-26e066d61719 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.529494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:34.547096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1263/2524] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:34 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:34.548408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ef92a-efa6-4871-981b-3b5e30cefc51 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.559025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ef92a-efa6-4871-981b-3b5e30cefc51 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.571414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:34.618717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924050-ab05-4a18-84fe-d85a7ab89095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.619342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924050-ab05-4a18-84fe-d85a7ab89095 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.619668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924050-ab05-4a18-84fe-d85a7ab89095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.619870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924050-ab05-4a18-84fe-d85a7ab89095 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.620504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62924050-ab05-4a18-84fe-d85a7ab89095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.622670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62924050-ab05-4a18-84fe-d85a7ab89095 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.644401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1262/2525] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:34 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:34.648385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f779d-afc3-418f-a03d-26e066d61719 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.659296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f779d-afc3-418f-a03d-26e066d61719 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.664111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3c8d-7955-4765-a011-a6d16ecc6b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.664719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3c8d-7955-4765-a011-a6d16ecc6b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.665080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3c8d-7955-4765-a011-a6d16ecc6b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.665397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3c8d-7955-4765-a011-a6d16ecc6b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.666158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3c8d-7955-4765-a011-a6d16ecc6b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.667967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3c8d-7955-4765-a011-a6d16ecc6b18 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.679193 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1264/2526] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:34.683426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924050-ab05-4a18-84fe-d85a7ab89095 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.694689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924050-ab05-4a18-84fe-d85a7ab89095 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.699378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef10b6-5ac7-47ea-b231-24ce0a3d0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.700030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef10b6-5ac7-47ea-b231-24ce0a3d0bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.700325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef10b6-5ac7-47ea-b231-24ce0a3d0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.700843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef10b6-5ac7-47ea-b231-24ce0a3d0bfc admin admin] PATH_INFO: `/v3/projects/c7cb26da4477478591a881960dd8f0e2/users/efdfee63b65f46f0a462f6287a77f889/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.716362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef10b6-5ac7-47ea-b231-24ce0a3d0bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7cb26da4477478591a881960dd8f0e2, user_id=efdfee63b65f46f0a462f6287a77f889, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.719260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef10b6-5ac7-47ea-b231-24ce0a3d0bfc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.734733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1263/2527] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:34 2022] PUT /identity/v3/projects/c7cb26da4477478591a881960dd8f0e2/users/efdfee63b65f46f0a462f6287a77f889/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:34.738745 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3c8d-7955-4765-a011-a6d16ecc6b18 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.749937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3c8d-7955-4765-a011-a6d16ecc6b18 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.807102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd69b5-b8b6-44d9-ae5a-340752a5f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.807823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd69b5-b8b6-44d9-ae5a-340752a5f2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.808101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd69b5-b8b6-44d9-ae5a-340752a5f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.808372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd69b5-b8b6-44d9-ae5a-340752a5f2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.809008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd69b5-b8b6-44d9-ae5a-340752a5f2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.810755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd69b5-b8b6-44d9-ae5a-340752a5f2b5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.824772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1265/2528] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:34.826031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef10b6-5ac7-47ea-b231-24ce0a3d0bfc admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.836688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef10b6-5ac7-47ea-b231-24ce0a3d0bfc admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:34.841642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:34.842893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.843320 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.843599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] PATH_INFO: `/v3/projects/c7cb26da4477478591a881960dd8f0e2/users/efdfee63b65f46f0a462f6287a77f889/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.845673 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7cb26da4477478591a881960dd8f0e2, user_id=efdfee63b65f46f0a462f6287a77f889, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:34.848403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:34.860174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1264/2529] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:34 2022] PUT /identity/v3/projects/c7cb26da4477478591a881960dd8f0e2/users/efdfee63b65f46f0a462f6287a77f889/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:34.870528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8513a-3989-49b6-9543-835551ad6ee7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:34.870812 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8513a-3989-49b6-9543-835551ad6ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:34.871084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8513a-3989-49b6-9543-835551ad6ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:34.898884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-51a8513a-3989-49b6-9543-835551ad6ee7 None None] MFA Rules not processed for user `efdfee63b65f46f0a462f6287a77f889`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:34.900084 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-51a8513a-3989-49b6-9543-835551ad6ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:34.967253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1266/2530] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:34.980707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:34.982503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:35.041102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46301787-8710-4c33-92ed-4a55895caafb admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:35.044824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f39b64-e7f5-4fa0-b238-022558777ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:35.045422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f39b64-e7f5-4fa0-b238-022558777ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:35.046286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f39b64-e7f5-4fa0-b238-022558777ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:35.046577 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f39b64-e7f5-4fa0-b238-022558777ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:35.055270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f39b64-e7f5-4fa0-b238-022558777ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:35.056700 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f39b64-e7f5-4fa0-b238-022558777ca3 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:35.066284 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1265/2531] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:35.142598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8513a-3989-49b6-9543-835551ad6ee7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:35.152192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8513a-3989-49b6-9543-835551ad6ee7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:35.156396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfcabc-00e5-43df-aa08-4b2db467c6d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:35.157027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfcabc-00e5-43df-aa08-4b2db467c6d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:35.157316 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfcabc-00e5-43df-aa08-4b2db467c6d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:35.157589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfcabc-00e5-43df-aa08-4b2db467c6d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:35.214367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfcabc-00e5-43df-aa08-4b2db467c6d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:35.215814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfcabc-00e5-43df-aa08-4b2db467c6d1 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:35.225310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1267/2532] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:35.500671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f39b64-e7f5-4fa0-b238-022558777ca3 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:35.564569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f39b64-e7f5-4fa0-b238-022558777ca3 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:35.569299 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:35.569999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:35.570274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:35.570542 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] PATH_INFO: `/v3/users/bb9c324952ae4175a449a7a1222d4bf8` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:35.571653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9c324952ae4175a449a7a1222d4bf8)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:35.573727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:35.588710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:35.624804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9c324952ae4175a449a7a1222d4bf8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:35.625559 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9c324952ae4175a449a7a1222d4bf8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:35.638109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9c324952ae4175a449a7a1222d4bf8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:35.647013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9c324952ae4175a449a7a1222d4bf8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:35.647799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9c324952ae4175a449a7a1222d4bf8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:35.660918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1266/2533] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:35 2022] DELETE /identity/v3/users/bb9c324952ae4175a449a7a1222d4bf8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:35.665557 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb77c8-abe0-475e-9925-608fdcc7dbf2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:35.666391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb77c8-abe0-475e-9925-608fdcc7dbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:35.666674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb77c8-abe0-475e-9925-608fdcc7dbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:35.674631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:35.688798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f0eb77c8-abe0-475e-9925-608fdcc7dbf2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:35.690302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f0eb77c8-abe0-475e-9925-608fdcc7dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:35.757350 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1268/2534] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:35.768286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:35.769731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:35.826682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ee79-4072-40a0-874a-5db56c075b5f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:35.831857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181ecc-1fde-46f0-839b-fe027e1b11a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:35.832456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181ecc-1fde-46f0-839b-fe027e1b11a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:35.832733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181ecc-1fde-46f0-839b-fe027e1b11a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:35.833005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181ecc-1fde-46f0-839b-fe027e1b11a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:35.841893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181ecc-1fde-46f0-839b-fe027e1b11a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:35.843365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181ecc-1fde-46f0-839b-fe027e1b11a3 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:35.852555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1267/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:36.199504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb77c8-abe0-475e-9925-608fdcc7dbf2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:36.201318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f0eb77c8-abe0-475e-9925-608fdcc7dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:36.215500 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb77c8-abe0-475e-9925-608fdcc7dbf2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:36.220855 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:36.221640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:36.221968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:36.222305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] PATH_INFO: `/v3/projects/3e32779ea1a149ce9c6cf962c4462f7f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:36.223600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e32779ea1a149ce9c6cf962c4462f7f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:36.226223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:36.273657 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e32779ea1a149ce9c6cf962c4462f7f', 'request_id': 'req-4df8056a-6852-4199-81f5-b4a688bb069b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.282219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e32779ea1a149ce9c6cf962c4462f7f', 'request_id': 'req-4df8056a-6852-4199-81f5-b4a688bb069b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.287960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e32779ea1a149ce9c6cf962c4462f7f', 'request_id': 'req-4df8056a-6852-4199-81f5-b4a688bb069b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.298950 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] The token cache is being invalidate because project 3e32779ea1a149ce9c6cf962c4462f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:36.299243 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.299878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.301386 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1269/2536] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:36 2022] DELETE /identity/v3/projects/3e32779ea1a149ce9c6cf962c4462f7f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:36.305385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181ecc-1fde-46f0-839b-fe027e1b11a3 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:36.315827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181ecc-1fde-46f0-839b-fe027e1b11a3 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:36.372636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:36.373294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:36.374173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:36.374420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] PATH_INFO: `/v3/users/efdfee63b65f46f0a462f6287a77f889` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:36.375644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efdfee63b65f46f0a462f6287a77f889)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:36.377597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:36.415180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:36.424274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efdfee63b65f46f0a462f6287a77f889'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.425055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efdfee63b65f46f0a462f6287a77f889'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.437578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efdfee63b65f46f0a462f6287a77f889'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.444952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efdfee63b65f46f0a462f6287a77f889'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.445590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e8946b0f-c24c-4dda-ae51-a418fc3af8c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efdfee63b65f46f0a462f6287a77f889'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.458291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1268/2537] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:36 2022] DELETE /identity/v3/users/efdfee63b65f46f0a462f6287a77f889 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:36.742031 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:36.743525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:36.759063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8056a-6852-4199-81f5-b4a688bb069b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:36.817787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:36.818407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:36.818692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:36.818970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] PATH_INFO: `/v3/projects/c7cb26da4477478591a881960dd8f0e2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:36.820077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7cb26da4477478591a881960dd8f0e2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:36.822054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:36.852444 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:36.871907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7cb26da4477478591a881960dd8f0e2', 'request_id': 'req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.880234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7cb26da4477478591a881960dd8f0e2', 'request_id': 'req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.885824 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7cb26da4477478591a881960dd8f0e2', 'request_id': 'req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.896890 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] The token cache is being invalidate because project c7cb26da4477478591a881960dd8f0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:36.897089 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.897729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a8486d3-2d6f-4d4f-8d10-2c8254463b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:36.899245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1270/2538] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:36 2022] DELETE /identity/v3/projects/c7cb26da4477478591a881960dd8f0e2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:36.905055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbb45-80db-4ddd-818b-5a1a3f6bc0b7 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:36.905581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbb45-80db-4ddd-818b-5a1a3f6bc0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:36.905581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbb45-80db-4ddd-818b-5a1a3f6bc0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:36.925383 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-225bbb45-80db-4ddd-818b-5a1a3f6bc0b7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:36.926642 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-225bbb45-80db-4ddd-818b-5a1a3f6bc0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:36.984992 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1269/2539] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:36.993004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bc3c-7917-4661-aa3f-4561597b8fe5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:36.993289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bc3c-7917-4661-aa3f-4561597b8fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:36.993561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432bc3c-7917-4661-aa3f-4561597b8fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.013328 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1432bc3c-7917-4661-aa3f-4561597b8fe5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:37.014763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1432bc3c-7917-4661-aa3f-4561597b8fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:37.022773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1271/2540] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:37.026959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bbb45-80db-4ddd-818b-5a1a3f6bc0b7 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.036958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bbb45-80db-4ddd-818b-5a1a3f6bc0b7 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.041702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.042348 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.042630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.042901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.043544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:37.043844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.046043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.057524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1270/2541] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:37.062301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432bc3c-7917-4661-aa3f-4561597b8fe5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.071372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432bc3c-7917-4661-aa3f-4561597b8fe5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.075941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e93cc-4314-437f-86fd-999bda5cd60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.076529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e93cc-4314-437f-86fd-999bda5cd60b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.076920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e93cc-4314-437f-86fd-999bda5cd60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.077200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e93cc-4314-437f-86fd-999bda5cd60b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.077967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e93cc-4314-437f-86fd-999bda5cd60b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.079864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e93cc-4314-437f-86fd-999bda5cd60b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.107112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1272/2542] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:37 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:37.112007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.122517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5e36-fd45-41ad-b622-4c507757a3b1 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.185726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4857-2956-4639-8e40-7c4903d1a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.190578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4857-2956-4639-8e40-7c4903d1a9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.190856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4857-2956-4639-8e40-7c4903d1a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.191123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4857-2956-4639-8e40-7c4903d1a9bb admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.191760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c4857-2956-4639-8e40-7c4903d1a9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.193754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c4857-2956-4639-8e40-7c4903d1a9bb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.216919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1271/2543] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:37 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:37.221938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e93cc-4314-437f-86fd-999bda5cd60b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.232471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e93cc-4314-437f-86fd-999bda5cd60b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.238196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0b1dc-dccf-433e-8b2f-a51db01e5a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.238867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0b1dc-dccf-433e-8b2f-a51db01e5a5a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.239290 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0b1dc-dccf-433e-8b2f-a51db01e5a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.239571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0b1dc-dccf-433e-8b2f-a51db01e5a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.240225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0b1dc-dccf-433e-8b2f-a51db01e5a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.242129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0b1dc-dccf-433e-8b2f-a51db01e5a5a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.254610 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1273/2544] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:37.258644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4857-2956-4639-8e40-7c4903d1a9bb admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.269142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4857-2956-4639-8e40-7c4903d1a9bb admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.276055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b6a53-9cb0-4197-871e-2800c4d79f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.276055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6a53-9cb0-4197-871e-2800c4d79f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.276055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6a53-9cb0-4197-871e-2800c4d79f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.276055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b6a53-9cb0-4197-871e-2800c4d79f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.278603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b6a53-9cb0-4197-871e-2800c4d79f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.278603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b6a53-9cb0-4197-871e-2800c4d79f17 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.289526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1272/2545] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:37.297434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0b1dc-dccf-433e-8b2f-a51db01e5a5a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.307587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0b1dc-dccf-433e-8b2f-a51db01e5a5a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.312323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.312964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.313249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.313529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] PATH_INFO: `/v3/projects/d07478cf0ea34377959cb6c2f768c53d/users/608e5674f1924f0aa4ebb3c3c2cac6e3/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.327851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07478cf0ea34377959cb6c2f768c53d, user_id=608e5674f1924f0aa4ebb3c3c2cac6e3, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.330572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.343953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1274/2546] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:37 2022] PUT /identity/v3/projects/d07478cf0ea34377959cb6c2f768c53d/users/608e5674f1924f0aa4ebb3c3c2cac6e3/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:37.355312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f70ac-40a1-4741-b1b7-42d8f14b00f8 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.355599 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f70ac-40a1-4741-b1b7-42d8f14b00f8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.355875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f70ac-40a1-4741-b1b7-42d8f14b00f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.383806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4c4f70ac-40a1-4741-b1b7-42d8f14b00f8 None None] MFA Rules not processed for user `608e5674f1924f0aa4ebb3c3c2cac6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:37.385031 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4c4f70ac-40a1-4741-b1b7-42d8f14b00f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:37.393092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:37.449713 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1273/2547] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:37.483633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.485543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:37.542222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dff24-8213-4728-ab23-6f39b0272d82 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.546322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd2ffe-e05a-4462-b88a-0ac806a1f828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.546909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd2ffe-e05a-4462-b88a-0ac806a1f828 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.547214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd2ffe-e05a-4462-b88a-0ac806a1f828 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.547484 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd2ffe-e05a-4462-b88a-0ac806a1f828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.555560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd2ffe-e05a-4462-b88a-0ac806a1f828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.556981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd2ffe-e05a-4462-b88a-0ac806a1f828 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.566646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1275/2548] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:37.581815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f70ac-40a1-4741-b1b7-42d8f14b00f8 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.653185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f70ac-40a1-4741-b1b7-42d8f14b00f8 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.658074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.658704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.659355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.659637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] PATH_INFO: `/v3/users/608e5674f1924f0aa4ebb3c3c2cac6e3` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.660758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] RBAC: Authorizing `identity:delete_user(user_id=608e5674f1924f0aa4ebb3c3c2cac6e3)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.662825 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.708530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608e5674f1924f0aa4ebb3c3c2cac6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:37.709181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608e5674f1924f0aa4ebb3c3c2cac6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:37.721024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608e5674f1924f0aa4ebb3c3c2cac6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:37.729158 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608e5674f1924f0aa4ebb3c3c2cac6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:37.729790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608e5674f1924f0aa4ebb3c3c2cac6e3'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:37.743240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1274/2549] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:37 2022] DELETE /identity/v3/users/608e5674f1924f0aa4ebb3c3c2cac6e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:37.747875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d412f-6293-45e6-9183-b342cdac329b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.748393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d412f-6293-45e6-9183-b342cdac329b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.748494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d412f-6293-45e6-9183-b342cdac329b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.767479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d84d412f-6293-45e6-9183-b342cdac329b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:37.768691 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d84d412f-6293-45e6-9183-b342cdac329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:37.817465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:37.830149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1276/2550] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:37.839806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:37.841254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:37.874353 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:37.901404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dcb28-8e1b-4100-b5cc-85c31e5c477a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:37.905880 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c1586-ee5d-4ab5-8af8-6657248b9c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:37.906486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c1586-ee5d-4ab5-8af8-6657248b9c02 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:37.906765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c1586-ee5d-4ab5-8af8-6657248b9c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:37.907037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c1586-ee5d-4ab5-8af8-6657248b9c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:37.915910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c1586-ee5d-4ab5-8af8-6657248b9c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:37.917349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c1586-ee5d-4ab5-8af8-6657248b9c02 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:37.927414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1275/2551] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:38.198030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d412f-6293-45e6-9183-b342cdac329b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.199481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d84d412f-6293-45e6-9183-b342cdac329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:38.213864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d412f-6293-45e6-9183-b342cdac329b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:38.219944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:38.220626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.220853 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.221124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] PATH_INFO: `/v3/projects/d07478cf0ea34377959cb6c2f768c53d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.222298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07478cf0ea34377959cb6c2f768c53d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:38.224168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:38.274896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07478cf0ea34377959cb6c2f768c53d', 'request_id': 'req-adca8041-b209-4c1c-bffe-68d5bc1085a7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:38.284583 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07478cf0ea34377959cb6c2f768c53d', 'request_id': 'req-adca8041-b209-4c1c-bffe-68d5bc1085a7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:38.290351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07478cf0ea34377959cb6c2f768c53d', 'request_id': 'req-adca8041-b209-4c1c-bffe-68d5bc1085a7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:38.302195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] The token cache is being invalidate because project d07478cf0ea34377959cb6c2f768c53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:38.302482 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:38.303169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adca8041-b209-4c1c-bffe-68d5bc1085a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:38.304652 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1277/2552] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:38 2022] DELETE /identity/v3/projects/d07478cf0ea34377959cb6c2f768c53d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:38.309339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58d8f-cfb2-46b8-af88-0b6e208da2ff None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.309631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58d8f-cfb2-46b8-af88-0b6e208da2ff None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.310398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58d8f-cfb2-46b8-af88-0b6e208da2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.331105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c4d58d8f-cfb2-46b8-af88-0b6e208da2ff None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:38.332325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c4d58d8f-cfb2-46b8-af88-0b6e208da2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:38.393043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1276/2553] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:38.400573 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4abb-4462-4c8c-b614-98b05f4b9eee None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.400860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4abb-4462-4c8c-b614-98b05f4b9eee None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.401248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d4abb-4462-4c8c-b614-98b05f4b9eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.421715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-245d4abb-4462-4c8c-b614-98b05f4b9eee None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:38.422984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-245d4abb-4462-4c8c-b614-98b05f4b9eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:38.430960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1278/2554] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:38.435165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d58d8f-cfb2-46b8-af88-0b6e208da2ff None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.445998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d58d8f-cfb2-46b8-af88-0b6e208da2ff None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:38.450778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:38.451375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.451708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.452217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.453056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:38.453360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:38.454987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:38.470037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1277/2555] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:38.471612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d4abb-4462-4c8c-b614-98b05f4b9eee None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.483503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d4abb-4462-4c8c-b614-98b05f4b9eee None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:38.488489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54682b5-71dd-4746-9fb4-7a0bbfb6ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:38.489086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54682b5-71dd-4746-9fb4-7a0bbfb6ffba admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.489359 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54682b5-71dd-4746-9fb4-7a0bbfb6ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.489625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54682b5-71dd-4746-9fb4-7a0bbfb6ffba admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.490352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54682b5-71dd-4746-9fb4-7a0bbfb6ffba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:38.492511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54682b5-71dd-4746-9fb4-7a0bbfb6ffba admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:38.521152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1279/2556] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:38 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:38.525425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.535576 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c9d3d-7786-4c34-a9fb-d82c6840d86b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:38.595018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e20c-0b60-4ce5-b044-f820d94078dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:38.595622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e20c-0b60-4ce5-b044-f820d94078dc admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.595901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e20c-0b60-4ce5-b044-f820d94078dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.596167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e20c-0b60-4ce5-b044-f820d94078dc admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.596779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e20c-0b60-4ce5-b044-f820d94078dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:38.598780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e20c-0b60-4ce5-b044-f820d94078dc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:38.620174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1278/2557] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:38 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:38.625125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54682b5-71dd-4746-9fb4-7a0bbfb6ffba admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.637200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54682b5-71dd-4746-9fb4-7a0bbfb6ffba admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:38.642053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ff4bd-d536-45ce-9eda-4348d2f18c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:38.642661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ff4bd-d536-45ce-9eda-4348d2f18c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.642946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ff4bd-d536-45ce-9eda-4348d2f18c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.643277 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ff4bd-d536-45ce-9eda-4348d2f18c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.643866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ff4bd-d536-45ce-9eda-4348d2f18c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:38.645467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ff4bd-d536-45ce-9eda-4348d2f18c04 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:38.656406 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1280/2558] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:38.660450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e20c-0b60-4ce5-b044-f820d94078dc admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.671247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e20c-0b60-4ce5-b044-f820d94078dc admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:38.675925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea2087-7ac9-4a06-86b8-aa7d14414f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:38.676525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2087-7ac9-4a06-86b8-aa7d14414f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.676807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2087-7ac9-4a06-86b8-aa7d14414f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.677106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2087-7ac9-4a06-86b8-aa7d14414f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.677750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea2087-7ac9-4a06-86b8-aa7d14414f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:38.679394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea2087-7ac9-4a06-86b8-aa7d14414f29 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:38.690442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1279/2559] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:38.694688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ff4bd-d536-45ce-9eda-4348d2f18c04 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.704917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ff4bd-d536-45ce-9eda-4348d2f18c04 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:38.711179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7336-bd60-47fd-bada-bdbc7e779cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:38.711830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7336-bd60-47fd-bada-bdbc7e779cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.712107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7336-bd60-47fd-bada-bdbc7e779cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.712376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7336-bd60-47fd-bada-bdbc7e779cd3 admin admin] PATH_INFO: `/v3/projects/13529b3a3f354918bcd8d85b9acf91ac/users/2ef46bcb84694a19b953756dbd5eedc3/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.727578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7336-bd60-47fd-bada-bdbc7e779cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13529b3a3f354918bcd8d85b9acf91ac, user_id=2ef46bcb84694a19b953756dbd5eedc3, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:38.730289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7336-bd60-47fd-bada-bdbc7e779cd3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:38.745220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1281/2560] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:38 2022] PUT /identity/v3/projects/13529b3a3f354918bcd8d85b9acf91ac/users/2ef46bcb84694a19b953756dbd5eedc3/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:38.755555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7fb-6861-4a8d-84f4-cf2a6126e40e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.755841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7fb-6861-4a8d-84f4-cf2a6126e40e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.756117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb7fb-6861-4a8d-84f4-cf2a6126e40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.784047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-af9cb7fb-6861-4a8d-84f4-cf2a6126e40e None None] MFA Rules not processed for user `2ef46bcb84694a19b953756dbd5eedc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:38.785415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-af9cb7fb-6861-4a8d-84f4-cf2a6126e40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:38.813365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:38.860522 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1280/2561] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:38.864968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7336-bd60-47fd-bada-bdbc7e779cd3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.928165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7336-bd60-47fd-bada-bdbc7e779cd3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:38.932750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecefac-6ae9-4080-a493-2431cead6516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:38.933353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecefac-6ae9-4080-a493-2431cead6516 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:38.933639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecefac-6ae9-4080-a493-2431cead6516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:38.933949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecefac-6ae9-4080-a493-2431cead6516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:38.934580 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecefac-6ae9-4080-a493-2431cead6516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:38.936524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecefac-6ae9-4080-a493-2431cead6516 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:38.957108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:38.964768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1282/2562] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:38 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:38.969169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb7fb-6861-4a8d-84f4-cf2a6126e40e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:38.979998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb7fb-6861-4a8d-84f4-cf2a6126e40e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.036374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88857fd4-5e57-4cd1-b708-0a547445b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.036977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88857fd4-5e57-4cd1-b708-0a547445b643 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.037261 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88857fd4-5e57-4cd1-b708-0a547445b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.037539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88857fd4-5e57-4cd1-b708-0a547445b643 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.038211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88857fd4-5e57-4cd1-b708-0a547445b643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.040177 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88857fd4-5e57-4cd1-b708-0a547445b643 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.061566 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1281/2563] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:38 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:39.065683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecefac-6ae9-4080-a493-2431cead6516 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.076291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecefac-6ae9-4080-a493-2431cead6516 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.081468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20fdc-c67c-45c1-8f04-454d4568616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.082095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20fdc-c67c-45c1-8f04-454d4568616d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.082374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20fdc-c67c-45c1-8f04-454d4568616d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.082648 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20fdc-c67c-45c1-8f04-454d4568616d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.083418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20fdc-c67c-45c1-8f04-454d4568616d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.085220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20fdc-c67c-45c1-8f04-454d4568616d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.096373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1283/2564] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:39.100381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88857fd4-5e57-4cd1-b708-0a547445b643 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.110585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88857fd4-5e57-4cd1-b708-0a547445b643 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.115278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d5368-1bff-4424-86cd-609afc767341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.115872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5368-1bff-4424-86cd-609afc767341 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.116156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5368-1bff-4424-86cd-609afc767341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.116693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d5368-1bff-4424-86cd-609afc767341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.117339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d5368-1bff-4424-86cd-609afc767341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.118990 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d5368-1bff-4424-86cd-609afc767341 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.129469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1282/2565] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:39.133987 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20fdc-c67c-45c1-8f04-454d4568616d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.144933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20fdc-c67c-45c1-8f04-454d4568616d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.149593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc548b-cbf4-43bf-a096-e74a36877042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.150288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc548b-cbf4-43bf-a096-e74a36877042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.150569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc548b-cbf4-43bf-a096-e74a36877042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.150849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc548b-cbf4-43bf-a096-e74a36877042 admin admin] PATH_INFO: `/v3/projects/fa8dffb3f93c4422bfe30940d15aa0aa/users/6026d255fc6a4a71a7b82875e4d662e6/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.166587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc548b-cbf4-43bf-a096-e74a36877042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8dffb3f93c4422bfe30940d15aa0aa, user_id=6026d255fc6a4a71a7b82875e4d662e6, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.169249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc548b-cbf4-43bf-a096-e74a36877042 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.183321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1284/2566] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:39 2022] PUT /identity/v3/projects/fa8dffb3f93c4422bfe30940d15aa0aa/users/6026d255fc6a4a71a7b82875e4d662e6/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:39.194808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10c7e5-443e-4304-8521-49683794f09d None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.195115 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10c7e5-443e-4304-8521-49683794f09d None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.195392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10c7e5-443e-4304-8521-49683794f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.226275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-4e10c7e5-443e-4304-8521-49683794f09d None None] MFA Rules not processed for user `6026d255fc6a4a71a7b82875e4d662e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:39.227508 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-4e10c7e5-443e-4304-8521-49683794f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:39.297218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1283/2567] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:39.301575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc548b-cbf4-43bf-a096-e74a36877042 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.365116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc548b-cbf4-43bf-a096-e74a36877042 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.370312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdc571-2592-4786-996c-9f90921bb3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.370916 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdc571-2592-4786-996c-9f90921bb3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.371199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdc571-2592-4786-996c-9f90921bb3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.371475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdc571-2592-4786-996c-9f90921bb3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.372108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdc571-2592-4786-996c-9f90921bb3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.374946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdc571-2592-4786-996c-9f90921bb3b9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.401563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1285/2568] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:39 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:39.405918 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10c7e5-443e-4304-8521-49683794f09d None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.416462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10c7e5-443e-4304-8521-49683794f09d None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.449426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:39.475897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb32a64-23db-41c4-bca3-a99a9a7b28e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.476485 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32a64-23db-41c4-bca3-a99a9a7b28e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.476768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32a64-23db-41c4-bca3-a99a9a7b28e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.477041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32a64-23db-41c4-bca3-a99a9a7b28e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.477651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb32a64-23db-41c4-bca3-a99a9a7b28e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.479626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb32a64-23db-41c4-bca3-a99a9a7b28e9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.504412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1284/2569] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:39 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:39.505777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdc571-2592-4786-996c-9f90921bb3b9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.517038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdc571-2592-4786-996c-9f90921bb3b9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.521746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a2335-cc04-43f6-aaf1-aaf80b863c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.522454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2335-cc04-43f6-aaf1-aaf80b863c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.522740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2335-cc04-43f6-aaf1-aaf80b863c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.523009 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2335-cc04-43f6-aaf1-aaf80b863c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.523645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a2335-cc04-43f6-aaf1-aaf80b863c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.525219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a2335-cc04-43f6-aaf1-aaf80b863c1c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.536427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1286/2570] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:39.540601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb32a64-23db-41c4-bca3-a99a9a7b28e9 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.550956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb32a64-23db-41c4-bca3-a99a9a7b28e9 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.555581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceb7cb-0e7b-471b-9d2f-30a173dac46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.556270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb7cb-0e7b-471b-9d2f-30a173dac46a admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.556550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb7cb-0e7b-471b-9d2f-30a173dac46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.556826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb7cb-0e7b-471b-9d2f-30a173dac46a admin admin] PATH_INFO: `/v3/projects/64da1cbaf1d64b09b76340f3a969a8ac/users/300390ece3184c89a84016c41ce758cd/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.573295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb7cb-0e7b-471b-9d2f-30a173dac46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64da1cbaf1d64b09b76340f3a969a8ac, user_id=300390ece3184c89a84016c41ce758cd, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.576103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb7cb-0e7b-471b-9d2f-30a173dac46a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.590923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1285/2571] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:39 2022] PUT /identity/v3/projects/64da1cbaf1d64b09b76340f3a969a8ac/users/300390ece3184c89a84016c41ce758cd/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:39.595171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a2335-cc04-43f6-aaf1-aaf80b863c1c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.605221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a2335-cc04-43f6-aaf1-aaf80b863c1c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.671052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9636eff-b2c8-4fc7-87ee-2985ec55a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.671695 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9636eff-b2c8-4fc7-87ee-2985ec55a509 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.671970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9636eff-b2c8-4fc7-87ee-2985ec55a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.672244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9636eff-b2c8-4fc7-87ee-2985ec55a509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.672879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9636eff-b2c8-4fc7-87ee-2985ec55a509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.674510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9636eff-b2c8-4fc7-87ee-2985ec55a509 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.684473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1287/2572] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:39.689234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceb7cb-0e7b-471b-9d2f-30a173dac46a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.699556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceb7cb-0e7b-471b-9d2f-30a173dac46a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.704102 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.704748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.705028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.705334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] PATH_INFO: `/v3/projects/64da1cbaf1d64b09b76340f3a969a8ac/users/300390ece3184c89a84016c41ce758cd/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.707263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64da1cbaf1d64b09b76340f3a969a8ac, user_id=300390ece3184c89a84016c41ce758cd, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.709984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.720349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1286/2573] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:39 2022] PUT /identity/v3/projects/64da1cbaf1d64b09b76340f3a969a8ac/users/300390ece3184c89a84016c41ce758cd/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:39.730493 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4766cd-65f5-4f55-af19-38f8f8d5898e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.730785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4766cd-65f5-4f55-af19-38f8f8d5898e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.731066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4766cd-65f5-4f55-af19-38f8f8d5898e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.759819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ed4766cd-65f5-4f55-af19-38f8f8d5898e None None] MFA Rules not processed for user `300390ece3184c89a84016c41ce758cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:39.761026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed4766cd-65f5-4f55-af19-38f8f8d5898e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:39.784416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:39.829455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1288/2574] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:39.840630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:39.843027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:39.900182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e9647-b61e-475c-9199-cd49ea0ca0d5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:39.903800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85c389-2df5-4afc-8c7a-f4e3e3c9effc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:39.904546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85c389-2df5-4afc-8c7a-f4e3e3c9effc service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:39.905440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85c389-2df5-4afc-8c7a-f4e3e3c9effc service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:39.905759 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85c389-2df5-4afc-8c7a-f4e3e3c9effc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:39.961180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85c389-2df5-4afc-8c7a-f4e3e3c9effc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:39.962608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85c389-2df5-4afc-8c7a-f4e3e3c9effc service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:39.972018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1287/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:41.482489 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4766cd-65f5-4f55-af19-38f8f8d5898e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:41.484076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed4766cd-65f5-4f55-af19-38f8f8d5898e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:41.496395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4766cd-65f5-4f55-af19-38f8f8d5898e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:41.500303 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:41.501030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:41.501317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:41.501593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:41.562055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:41.563514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:41.572481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1289/2576] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:42.150688 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85c389-2df5-4afc-8c7a-f4e3e3c9effc service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:42.160842 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85c389-2df5-4afc-8c7a-f4e3e3c9effc service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:42.164442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:42.165051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:42.165328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:42.165598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:42.174838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:42.176269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:42.186035 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1288/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:43.039249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:43.040725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:43.100183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfd9a6-dd2f-4d14-bd6a-f15b52ede7d4 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:43.103763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:43.104433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:43.104722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:43.104988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:43.106767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:43.180706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:43.182356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:43.194094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1290/2578] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:44.433971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:44.435538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.480048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:44.541910 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ef6a8-2363-480f-b73c-f628877ec961 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:44.554578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aba061-636f-483e-b59a-5a518d81a257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:44.555417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba061-636f-483e-b59a-5a518d81a257 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:44.555824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba061-636f-483e-b59a-5a518d81a257 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:44.556201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba061-636f-483e-b59a-5a518d81a257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:44.558283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d4aba061-636f-483e-b59a-5a518d81a257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.575136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aba061-636f-483e-b59a-5a518d81a257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:44.577923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aba061-636f-483e-b59a-5a518d81a257 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:44.591766 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1289/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:46.251743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:46.267201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:46.326504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41baf5f-01d4-4993-a824-e0fb8078b720 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:46.331213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:46.331799 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:46.332218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:46.332527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] PATH_INFO: `/v3/users/2ef46bcb84694a19b953756dbd5eedc3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:46.333641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef46bcb84694a19b953756dbd5eedc3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:46.335803 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:46.390953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef46bcb84694a19b953756dbd5eedc3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:46.391758 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef46bcb84694a19b953756dbd5eedc3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:46.408928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef46bcb84694a19b953756dbd5eedc3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:46.419615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef46bcb84694a19b953756dbd5eedc3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:46.421613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef46bcb84694a19b953756dbd5eedc3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:46.440242 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1291/2580] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:46 2022] DELETE /identity/v3/users/2ef46bcb84694a19b953756dbd5eedc3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:46.442208 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a050-e361-4aa5-bc3d-a5ded45312e9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:46.442722 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a050-e361-4aa5-bc3d-a5ded45312e9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:46.442838 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4a050-e361-4aa5-bc3d-a5ded45312e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:46.462712 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ddc4a050-e361-4aa5-bc3d-a5ded45312e9 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:46.463932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ddc4a050-e361-4aa5-bc3d-a5ded45312e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:46.549561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1290/2581] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:46.596679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:46.598540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:46.668544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ffa4b-5636-4f18-b135-24a7a2b4e632 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:46.674408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d874f-0c0e-430f-95b9-326172c80d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:46.675035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d874f-0c0e-430f-95b9-326172c80d16 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:46.675313 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d874f-0c0e-430f-95b9-326172c80d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:46.675588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d874f-0c0e-430f-95b9-326172c80d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:46.688697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d874f-0c0e-430f-95b9-326172c80d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:46.690210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d874f-0c0e-430f-95b9-326172c80d16 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:46.703425 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1292/2582] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:47.621863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4a050-e361-4aa5-bc3d-a5ded45312e9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:47.625048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ddc4a050-e361-4aa5-bc3d-a5ded45312e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:47.642246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4a050-e361-4aa5-bc3d-a5ded45312e9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:47.647117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:47.647955 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:47.648393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:47.648837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] PATH_INFO: `/v3/projects/13529b3a3f354918bcd8d85b9acf91ac` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:47.650309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13529b3a3f354918bcd8d85b9acf91ac)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:47.652647 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:47.715752 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13529b3a3f354918bcd8d85b9acf91ac', 'request_id': 'req-f3721edf-6ba6-460b-82ed-ba7f36349f77'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.723161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13529b3a3f354918bcd8d85b9acf91ac', 'request_id': 'req-f3721edf-6ba6-460b-82ed-ba7f36349f77'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.731306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13529b3a3f354918bcd8d85b9acf91ac', 'request_id': 'req-f3721edf-6ba6-460b-82ed-ba7f36349f77'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.748236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] The token cache is being invalidate because project 13529b3a3f354918bcd8d85b9acf91ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:47.748584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.749499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.751349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1291/2583] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:47 2022] DELETE /identity/v3/projects/13529b3a3f354918bcd8d85b9acf91ac => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:47.755945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d874f-0c0e-430f-95b9-326172c80d16 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:47.766503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d874f-0c0e-430f-95b9-326172c80d16 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:47.801398 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:47.834878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:47.835632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:47.836114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:47.836626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] PATH_INFO: `/v3/users/6026d255fc6a4a71a7b82875e4d662e6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:47.837988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6026d255fc6a4a71a7b82875e4d662e6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:47.840797 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:47.908827 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6026d255fc6a4a71a7b82875e4d662e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.909505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6026d255fc6a4a71a7b82875e4d662e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.927766 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6026d255fc6a4a71a7b82875e4d662e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.937934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6026d255fc6a4a71a7b82875e4d662e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.938779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6026d255fc6a4a71a7b82875e4d662e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:47.960840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1293/2584] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:47 2022] DELETE /identity/v3/users/6026d255fc6a4a71a7b82875e4d662e6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:48.561742 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:48.563334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:48.599533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3721edf-6ba6-460b-82ed-ba7f36349f77 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:48.639845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:48.666772 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:48.667411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:48.667693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:48.667966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] PATH_INFO: `/v3/projects/fa8dffb3f93c4422bfe30940d15aa0aa` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:48.669108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8dffb3f93c4422bfe30940d15aa0aa)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:48.672040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:48.739041 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8dffb3f93c4422bfe30940d15aa0aa', 'request_id': 'req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:48.746085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8dffb3f93c4422bfe30940d15aa0aa', 'request_id': 'req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:48.756682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8dffb3f93c4422bfe30940d15aa0aa', 'request_id': 'req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:48.773650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] The token cache is being invalidate because project fa8dffb3f93c4422bfe30940d15aa0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:48.774103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:48.774958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:48.780813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1292/2585] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:48 2022] DELETE /identity/v3/projects/fa8dffb3f93c4422bfe30940d15aa0aa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:48.782058 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:48.783683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:48.800847 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1048e5-46f7-4524-942b-3e178c94d7a6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:48.884321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:48.885468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:48.885826 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:48.886135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] PATH_INFO: `/v3/users/300390ece3184c89a84016c41ce758cd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:48.887585 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=300390ece3184c89a84016c41ce758cd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:48.890342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:48.962194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300390ece3184c89a84016c41ce758cd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:48.963494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300390ece3184c89a84016c41ce758cd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:48.976872 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:48.990706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300390ece3184c89a84016c41ce758cd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.011961 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300390ece3184c89a84016c41ce758cd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.012896 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300390ece3184c89a84016c41ce758cd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.030126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1294/2586] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:48 2022] DELETE /identity/v3/users/300390ece3184c89a84016c41ce758cd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:49.488554 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:49.490062 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:49.508310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b68ff2-59c8-4acd-9b0a-3d809baa261c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:49.593155 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:49.593997 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:49.594438 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:49.594620 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] PATH_INFO: `/v3/projects/64da1cbaf1d64b09b76340f3a969a8ac` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:49.596714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64da1cbaf1d64b09b76340f3a969a8ac)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:49.599441 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:49.672913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64da1cbaf1d64b09b76340f3a969a8ac', 'request_id': 'req-13083e1e-871e-44be-9262-43b70dcafd3e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.681435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64da1cbaf1d64b09b76340f3a969a8ac', 'request_id': 'req-13083e1e-871e-44be-9262-43b70dcafd3e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.693571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64da1cbaf1d64b09b76340f3a969a8ac', 'request_id': 'req-13083e1e-871e-44be-9262-43b70dcafd3e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.706121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:49.713776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] The token cache is being invalidate because project 64da1cbaf1d64b09b76340f3a969a8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:49.714204 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.718624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.721735 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1293/2587] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:49 2022] DELETE /identity/v3/projects/64da1cbaf1d64b09b76340f3a969a8ac => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:49.792258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:49.794291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:49.880418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb30f2-b0de-422a-8f61-5b1f55f981aa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:49.944136 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:49.944791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:49.945090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:49.945364 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:49.947324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:50.027082 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.028519 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.038307 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1295/2588] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:52.219644 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:52.221114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:52.234836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13083e1e-871e-44be-9262-43b70dcafd3e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:52.238442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:52.239060 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:52.239339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:52.239614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:52.241451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:52.254567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:52.256026 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:52.266956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1294/2589] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:55.903212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:55.906092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:55.919540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed988-676d-4e35-91f8-c8bb5435de71 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:55.925166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:55.925786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:55.926135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:55.926415 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] PATH_INFO: `/v3/users/59499f8f98f9474c8eda196a712d752e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:55.927567 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59499f8f98f9474c8eda196a712d752e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:55.929486 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:55.969385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:55.980863 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59499f8f98f9474c8eda196a712d752e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:55.981951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59499f8f98f9474c8eda196a712d752e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:55.995391 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59499f8f98f9474c8eda196a712d752e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.003727 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59499f8f98f9474c8eda196a712d752e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.004455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-57afcc4a-c30a-4d73-b44a-8cf8ca17e209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59499f8f98f9474c8eda196a712d752e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.018450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1296/2590] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:55 2022] DELETE /identity/v3/users/59499f8f98f9474c8eda196a712d752e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:56.235109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.251892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b4dc9-7157-4c3b-a2c8-eb3dca8796f2 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.345247 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.346387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.346863 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.347369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] PATH_INFO: `/v3/projects/af9651358194459e92926965c4d4afe0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.348895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9651358194459e92926965c4d4afe0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:56.351828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:56.411365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9651358194459e92926965c4d4afe0', 'request_id': 'req-20c51486-e5c2-4828-8216-22bbeb51685b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.424024 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9651358194459e92926965c4d4afe0', 'request_id': 'req-20c51486-e5c2-4828-8216-22bbeb51685b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.431334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9651358194459e92926965c4d4afe0', 'request_id': 'req-20c51486-e5c2-4828-8216-22bbeb51685b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.444958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] The token cache is being invalidate because project af9651358194459e92926965c4d4afe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:56.445643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.446721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-20c51486-e5c2-4828-8216-22bbeb51685b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.449893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1295/2591] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:56 2022] DELETE /identity/v3/projects/af9651358194459e92926965c4d4afe0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:56.455895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b9d71-098a-4936-afc4-2e6da531ff8b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.457627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b9d71-098a-4936-afc4-2e6da531ff8b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.458959 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b9d71-098a-4936-afc4-2e6da531ff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.487452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-716b9d71-098a-4936-afc4-2e6da531ff8b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:56.488674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-716b9d71-098a-4936-afc4-2e6da531ff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:56.560094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1297/2592] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:56.569367 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b47a-c92b-4060-b5ea-c52dd5d17a74 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.569655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b47a-c92b-4060-b5ea-c52dd5d17a74 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.570019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b47a-c92b-4060-b5ea-c52dd5d17a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.596875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-6170b47a-c92b-4060-b5ea-c52dd5d17a74 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:56.598881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6170b47a-c92b-4060-b5ea-c52dd5d17a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:56.607103 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1296/2593] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:56.612341 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b9d71-098a-4936-afc4-2e6da531ff8b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.633236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b9d71-098a-4936-afc4-2e6da531ff8b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.638805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.643462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.643462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.643938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.644922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:56.645324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:56.647706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:56.666487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1298/2594] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:56.668039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b47a-c92b-4060-b5ea-c52dd5d17a74 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.679993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b47a-c92b-4060-b5ea-c52dd5d17a74 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.687051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.687674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.687953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.688224 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.688883 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:56.691280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:56.749405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1297/2595] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:56 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:56.759210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.771954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f9953-c81d-4258-a9bf-18fcc39f0f5a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.813757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.815826 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:56.869453 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed06e4-3567-41bc-8936-d9c50aae45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.870103 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed06e4-3567-41bc-8936-d9c50aae45af admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.870388 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed06e4-3567-41bc-8936-d9c50aae45af admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.870669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed06e4-3567-41bc-8936-d9c50aae45af admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.871305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed06e4-3567-41bc-8936-d9c50aae45af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:56.874163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed06e4-3567-41bc-8936-d9c50aae45af admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:56.880939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:56.901394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1299/2596] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:56 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:56.902466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c0129-3bb8-4721-9ed1-6c18508eb46e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.902615 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed06e4-3567-41bc-8936-d9c50aae45af admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.908267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.908943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.909227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.909505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] PATH_INFO: `/v3/users/099323741be9414bbd9860d5ec6e90ad` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.910691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099323741be9414bbd9860d5ec6e90ad)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:56.912747 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:56.913448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed06e4-3567-41bc-8936-d9c50aae45af admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.918360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59041da-4b34-485a-ade9-b904755be3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.918964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59041da-4b34-485a-ade9-b904755be3aa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.919245 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59041da-4b34-485a-ade9-b904755be3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.919529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59041da-4b34-485a-ade9-b904755be3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.920808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59041da-4b34-485a-ade9-b904755be3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:56.922553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59041da-4b34-485a-ade9-b904755be3aa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:56.936935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1300/2597] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:56.938699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59041da-4b34-485a-ade9-b904755be3aa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.950029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59041da-4b34-485a-ade9-b904755be3aa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.955762 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa9209-0d99-433c-b292-99c0e316b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.956551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9209-0d99-433c-b292-99c0e316b682 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.956836 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9209-0d99-433c-b292-99c0e316b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.957111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9209-0d99-433c-b292-99c0e316b682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.957899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa9209-0d99-433c-b292-99c0e316b682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:56.959528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa9209-0d99-433c-b292-99c0e316b682 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:56.971241 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1301/2598] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:56.975267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa9209-0d99-433c-b292-99c0e316b682 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.978317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099323741be9414bbd9860d5ec6e90ad'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.979114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099323741be9414bbd9860d5ec6e90ad'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.986829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa9209-0d99-433c-b292-99c0e316b682 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.993967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099323741be9414bbd9860d5ec6e90ad'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.994319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.994992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.995321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.995601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] PATH_INFO: `/v3/projects/9342b231865c4403a4b4f09c6df22dc8/users/4c949f5fdcf6432cb2080b913036502f/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.998747 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:57.008816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099323741be9414bbd9860d5ec6e90ad'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.009666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dedd2b73-f276-4525-b1c5-0c10ae970a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099323741be9414bbd9860d5ec6e90ad'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.015663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9342b231865c4403a4b4f09c6df22dc8, user_id=4c949f5fdcf6432cb2080b913036502f, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.018441 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.031561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1298/2599] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:56 2022] DELETE /identity/v3/users/099323741be9414bbd9860d5ec6e90ad => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:57.042210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1302/2600] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:56 2022] PUT /identity/v3/projects/9342b231865c4403a4b4f09c6df22dc8/users/4c949f5fdcf6432cb2080b913036502f/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:57.052728 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5263c9-376d-4590-a903-9c96c51a98dd None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.053294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5263c9-376d-4590-a903-9c96c51a98dd None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.053598 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5263c9-376d-4590-a903-9c96c51a98dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.090287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-db5263c9-376d-4590-a903-9c96c51a98dd None None] MFA Rules not processed for user `4c949f5fdcf6432cb2080b913036502f`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:57.091527 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-db5263c9-376d-4590-a903-9c96c51a98dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.171003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1299/2601] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:57.175838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.177689 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.223205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5263c9-376d-4590-a903-9c96c51a98dd None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.224726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-db5263c9-376d-4590-a903-9c96c51a98dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.267940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda5385-cb90-4129-9bda-9a215f3902e6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.291095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:57.297456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5263c9-376d-4590-a903-9c96c51a98dd None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.303310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.304023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.304342 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.304797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] PATH_INFO: `/v3/projects/fb3881530fcf4c0bb477ce102c724555` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.306636 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3881530fcf4c0bb477ce102c724555)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.308630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.327346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25609cd-1672-44de-b9c4-7e39a2681752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.327965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25609cd-1672-44de-b9c4-7e39a2681752 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.328244 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25609cd-1672-44de-b9c4-7e39a2681752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.328521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25609cd-1672-44de-b9c4-7e39a2681752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.329161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25609cd-1672-44de-b9c4-7e39a2681752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.331108 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25609cd-1672-44de-b9c4-7e39a2681752 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.359068 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1303/2602] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:57 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:57.360682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3881530fcf4c0bb477ce102c724555', 'request_id': 'req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.363083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25609cd-1672-44de-b9c4-7e39a2681752 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.366468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3881530fcf4c0bb477ce102c724555', 'request_id': 'req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.374674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3881530fcf4c0bb477ce102c724555', 'request_id': 'req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.386195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] The token cache is being invalidate because project fb3881530fcf4c0bb477ce102c724555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:57.386484 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.387166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.388718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1300/2603] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:57 2022] DELETE /identity/v3/projects/fb3881530fcf4c0bb477ce102c724555 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:57.392812 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.394158 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.426515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25609cd-1672-44de-b9c4-7e39a2681752 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.431923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.432529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.432817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.433092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.433750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.436239 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.461445 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1304/2604] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:57 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:57.463188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.464845 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.465985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734ab2-d34e-41eb-96eb-6fb1f79f36c7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.470753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.471388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.471683 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.471943 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] PATH_INFO: `/v3/users/ce7d45cdd9d24676972c971e37f378a8` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.473076 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7d45cdd9d24676972c971e37f378a8)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.473965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:57.475214 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.477492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c34038-e10a-46fd-91e8-aacc4a70e619 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.483794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4735-24fa-448f-a5db-d07593b2910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.484553 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4735-24fa-448f-a5db-d07593b2910a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.484837 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4735-24fa-448f-a5db-d07593b2910a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.485112 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4735-24fa-448f-a5db-d07593b2910a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.485754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4735-24fa-448f-a5db-d07593b2910a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.487403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4735-24fa-448f-a5db-d07593b2910a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.503083 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1305/2605] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:57.504512 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4735-24fa-448f-a5db-d07593b2910a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.516130 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4735-24fa-448f-a5db-d07593b2910a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.521064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.522285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.522565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.522861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] PATH_INFO: `/v3/projects/0138335e815643899ff6f971e592f698/users/927060753f534e7b90f12c4c584088e0/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.526884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7d45cdd9d24676972c971e37f378a8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.527543 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7d45cdd9d24676972c971e37f378a8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.538337 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0138335e815643899ff6f971e592f698, user_id=927060753f534e7b90f12c4c584088e0, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.539750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7d45cdd9d24676972c971e37f378a8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.541077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.547694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7d45cdd9d24676972c971e37f378a8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.548437 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7d45cdd9d24676972c971e37f378a8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.554912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1306/2606] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:57 2022] PUT /identity/v3/projects/0138335e815643899ff6f971e592f698/users/927060753f534e7b90f12c4c584088e0/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:57.558838 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.560479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.562426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1301/2607] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:57 2022] DELETE /identity/v3/users/ce7d45cdd9d24676972c971e37f378a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:57.631536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98beea-d9d1-40c9-b473-93153682db47 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.691214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.691846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.692128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.692418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.693052 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.694671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.705528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1307/2608] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:57.709800 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.718525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:57.722553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5840-73a9-47f0-9aaf-20df6521bd13 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.728898 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf65d9-3356-46f7-bbc4-0beb18630014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.730029 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf65d9-3356-46f7-bbc4-0beb18630014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.730468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf65d9-3356-46f7-bbc4-0beb18630014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.730819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf65d9-3356-46f7-bbc4-0beb18630014 admin admin] PATH_INFO: `/v3/projects/0138335e815643899ff6f971e592f698/users/927060753f534e7b90f12c4c584088e0/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.733387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf65d9-3356-46f7-bbc4-0beb18630014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0138335e815643899ff6f971e592f698, user_id=927060753f534e7b90f12c4c584088e0, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.736515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf65d9-3356-46f7-bbc4-0beb18630014 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.743059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.744981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.750926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1302/2609] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:57 2022] PUT /identity/v3/projects/0138335e815643899ff6f971e592f698/users/927060753f534e7b90f12c4c584088e0/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:57.758461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17327975-51ab-4653-a629-2a02af3f05b6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.761374 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3cfa-d4ed-4f4c-ab72-e0ff92910a26 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.762191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3cfa-d4ed-4f4c-ab72-e0ff92910a26 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.762368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3cfa-d4ed-4f4c-ab72-e0ff92910a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.796286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-305c3cfa-d4ed-4f4c-ab72-e0ff92910a26 None None] MFA Rules not processed for user `927060753f534e7b90f12c4c584088e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:57.797500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-305c3cfa-d4ed-4f4c-ab72-e0ff92910a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.821481 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.822147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.822434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.822697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] PATH_INFO: `/v3/projects/2f5fd572613240ca8a1d995bcd022d38` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.823946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5fd572613240ca8a1d995bcd022d38)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.825866 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.843970 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:57.869915 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1303/2610] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:57.875688 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5fd572613240ca8a1d995bcd022d38', 'request_id': 'req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.881634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c3cfa-d4ed-4f4c-ab72-e0ff92910a26 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.883151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-305c3cfa-d4ed-4f4c-ab72-e0ff92910a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.884399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5fd572613240ca8a1d995bcd022d38', 'request_id': 'req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.891636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5fd572613240ca8a1d995bcd022d38', 'request_id': 'req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.902708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] The token cache is being invalidate because project 2f5fd572613240ca8a1d995bcd022d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:57.903001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.903660 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.906003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1308/2611] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:57 2022] DELETE /identity/v3/projects/2f5fd572613240ca8a1d995bcd022d38 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:57.948083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c3cfa-d4ed-4f4c-ab72-e0ff92910a26 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:58.003314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202c8bf-0593-44a5-8933-e9e8f8294171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:58.003924 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202c8bf-0593-44a5-8933-e9e8f8294171 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.004203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202c8bf-0593-44a5-8933-e9e8f8294171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.004475 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202c8bf-0593-44a5-8933-e9e8f8294171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.006979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c202c8bf-0593-44a5-8933-e9e8f8294171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:58.058590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:58.078985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202c8bf-0593-44a5-8933-e9e8f8294171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:58.080506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202c8bf-0593-44a5-8933-e9e8f8294171 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:58.091333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1304/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:46:58.524135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:58.525659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:58.588846 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acb6bc-c7e7-4c9c-a5bd-3c57aa840715 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:58.593907 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:58.594569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.594850 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.595147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] PATH_INFO: `/v3/users/4c949f5fdcf6432cb2080b913036502f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.596288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c949f5fdcf6432cb2080b913036502f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:58.598260 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:58.644490 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c949f5fdcf6432cb2080b913036502f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:58.645138 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c949f5fdcf6432cb2080b913036502f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:58.657093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c949f5fdcf6432cb2080b913036502f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:58.665060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c949f5fdcf6432cb2080b913036502f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:58.665686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c949f5fdcf6432cb2080b913036502f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:58.678625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1309/2613] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:58 2022] DELETE /identity/v3/users/4c949f5fdcf6432cb2080b913036502f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:58.683148 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e1f93-8a93-48fe-9b8a-39f7912abd68 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.683616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e1f93-8a93-48fe-9b8a-39f7912abd68 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.683741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e1f93-8a93-48fe-9b8a-39f7912abd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.702790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c98e1f93-8a93-48fe-9b8a-39f7912abd68 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:58.703981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c98e1f93-8a93-48fe-9b8a-39f7912abd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:58.762493 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1305/2614] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:58.772055 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:58.773450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:58.801000 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:58.833751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1420a-bc05-448c-b80d-60a018ae9e18 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:58.837456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a824989-dd2c-45eb-b841-7a4bb5aa3741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:58.838097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824989-dd2c-45eb-b841-7a4bb5aa3741 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.838382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824989-dd2c-45eb-b841-7a4bb5aa3741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.838659 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824989-dd2c-45eb-b841-7a4bb5aa3741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.848458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a824989-dd2c-45eb-b841-7a4bb5aa3741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:58.849931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a824989-dd2c-45eb-b841-7a4bb5aa3741 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:58.860510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1310/2615] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:59.384575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e1f93-8a93-48fe-9b8a-39f7912abd68 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:59.386093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c98e1f93-8a93-48fe-9b8a-39f7912abd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:59.399051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e1f93-8a93-48fe-9b8a-39f7912abd68 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:59.403671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:59.405122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:59.405408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:59.405690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] PATH_INFO: `/v3/projects/9342b231865c4403a4b4f09c6df22dc8` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:59.406841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9342b231865c4403a4b4f09c6df22dc8)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:59.409704 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:59.459130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9342b231865c4403a4b4f09c6df22dc8', 'request_id': 'req-0c6b6591-d642-418c-89e8-21b4169441c6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.464807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9342b231865c4403a4b4f09c6df22dc8', 'request_id': 'req-0c6b6591-d642-418c-89e8-21b4169441c6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.471561 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9342b231865c4403a4b4f09c6df22dc8', 'request_id': 'req-0c6b6591-d642-418c-89e8-21b4169441c6'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.483143 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] The token cache is being invalidate because project 9342b231865c4403a4b4f09c6df22dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:59.483435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.484078 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.485557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1306/2616] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:59 2022] DELETE /identity/v3/projects/9342b231865c4403a4b4f09c6df22dc8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:59.489565 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a824989-dd2c-45eb-b841-7a4bb5aa3741 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:59.500432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a824989-dd2c-45eb-b841-7a4bb5aa3741 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:59.555433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:59.556133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:59.556326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:59.556604 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] PATH_INFO: `/v3/users/927060753f534e7b90f12c4c584088e0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:59.557722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=927060753f534e7b90f12c4c584088e0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:59.559681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:59.604700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927060753f534e7b90f12c4c584088e0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.605276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927060753f534e7b90f12c4c584088e0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.618700 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927060753f534e7b90f12c4c584088e0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.627281 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927060753f534e7b90f12c4c584088e0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.627981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-39830cc5-ca69-45f3-96a3-3d7dbd0fe8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927060753f534e7b90f12c4c584088e0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.640211 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1311/2617] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:59 2022] DELETE /identity/v3/users/927060753f534e7b90f12c4c584088e0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:59.911681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:59.913226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:59.927466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b6591-d642-418c-89e8-21b4169441c6 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:59.984777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:59.985410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:59.985691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:59.986127 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] PATH_INFO: `/v3/projects/0138335e815643899ff6f971e592f698` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:59.987099 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0138335e815643899ff6f971e592f698)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:59.989015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:59.997373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:00.036956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0138335e815643899ff6f971e592f698', 'request_id': 'req-cf68c36b-3892-4061-9145-52f0b79027a7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.042365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0138335e815643899ff6f971e592f698', 'request_id': 'req-cf68c36b-3892-4061-9145-52f0b79027a7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.049618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0138335e815643899ff6f971e592f698', 'request_id': 'req-cf68c36b-3892-4061-9145-52f0b79027a7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.060663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] The token cache is being invalidate because project 0138335e815643899ff6f971e592f698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:00.060953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.061587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-cf68c36b-3892-4061-9145-52f0b79027a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.063087 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1307/2618] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:59 2022] DELETE /identity/v3/projects/0138335e815643899ff6f971e592f698 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:00.067910 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cca3c4-1891-4fdc-9f27-21a24c575530 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.068192 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cca3c4-1891-4fdc-9f27-21a24c575530 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.068465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cca3c4-1891-4fdc-9f27-21a24c575530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.088051 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d5cca3c4-1891-4fdc-9f27-21a24c575530 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:00.089261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d5cca3c4-1891-4fdc-9f27-21a24c575530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:00.132646 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:00.153342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1312/2619] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:00.163043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f3f8-2df2-4ef4-96e4-0fa5a2d0267e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.163333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f3f8-2df2-4ef4-96e4-0fa5a2d0267e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.163612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8f3f8-2df2-4ef4-96e4-0fa5a2d0267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.183921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-6bd8f3f8-2df2-4ef4-96e4-0fa5a2d0267e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:00.185122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-6bd8f3f8-2df2-4ef4-96e4-0fa5a2d0267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:00.193420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1308/2620] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:00.197523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cca3c4-1891-4fdc-9f27-21a24c575530 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.207986 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cca3c4-1891-4fdc-9f27-21a24c575530 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.212731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.213329 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.213611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.213918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.214559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:00.214865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.216450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.228460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1313/2621] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:00.232782 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8f3f8-2df2-4ef4-96e4-0fa5a2d0267e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.242579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8f3f8-2df2-4ef4-96e4-0fa5a2d0267e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.247229 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82111021-d530-444c-8c70-8ea866541a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.247822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111021-d530-444c-8c70-8ea866541a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.248150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111021-d530-444c-8c70-8ea866541a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.248421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111021-d530-444c-8c70-8ea866541a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.249053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82111021-d530-444c-8c70-8ea866541a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.250984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82111021-d530-444c-8c70-8ea866541a01 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.278659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1309/2622] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:00 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:00.283676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.293629 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436609a-ba27-46ed-ab73-0dd3694a0e8c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.350064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cb1e6-0ae0-48bb-9ce3-5e1974add200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.350673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb1e6-0ae0-48bb-9ce3-5e1974add200 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.350960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb1e6-0ae0-48bb-9ce3-5e1974add200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.351238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cb1e6-0ae0-48bb-9ce3-5e1974add200 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.351886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cb1e6-0ae0-48bb-9ce3-5e1974add200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.353804 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588cb1e6-0ae0-48bb-9ce3-5e1974add200 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.376497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1314/2623] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:00 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:00.380698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82111021-d530-444c-8c70-8ea866541a01 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.391710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82111021-d530-444c-8c70-8ea866541a01 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.396292 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7e889-f024-48c2-8df8-79538f3f15ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.396903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e889-f024-48c2-8df8-79538f3f15ac admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.397162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e889-f024-48c2-8df8-79538f3f15ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.397430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7e889-f024-48c2-8df8-79538f3f15ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.398104 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7e889-f024-48c2-8df8-79538f3f15ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.399694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7e889-f024-48c2-8df8-79538f3f15ac admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.409445 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1310/2624] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:00.413319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cb1e6-0ae0-48bb-9ce3-5e1974add200 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.423334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cb1e6-0ae0-48bb-9ce3-5e1974add200 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.428019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90de74-49a6-432a-9304-d151aee84bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.428623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90de74-49a6-432a-9304-d151aee84bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.428898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90de74-49a6-432a-9304-d151aee84bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.429176 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90de74-49a6-432a-9304-d151aee84bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.429818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90de74-49a6-432a-9304-d151aee84bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.431922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90de74-49a6-432a-9304-d151aee84bc1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.443375 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1315/2625] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:00.447753 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7e889-f024-48c2-8df8-79538f3f15ac admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.459591 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7e889-f024-48c2-8df8-79538f3f15ac admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.464238 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336af0d-e697-47d1-b257-382ded218052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.464885 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336af0d-e697-47d1-b257-382ded218052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.465174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336af0d-e697-47d1-b257-382ded218052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.465453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336af0d-e697-47d1-b257-382ded218052 admin admin] PATH_INFO: `/v3/projects/8bcc57b41b7640248cc20a686184ed3b/users/7d6af1fd66f54363ad8361afb1e6b361/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.479914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336af0d-e697-47d1-b257-382ded218052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcc57b41b7640248cc20a686184ed3b, user_id=7d6af1fd66f54363ad8361afb1e6b361, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.482626 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336af0d-e697-47d1-b257-382ded218052 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.495562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1311/2626] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:00 2022] PUT /identity/v3/projects/8bcc57b41b7640248cc20a686184ed3b/users/7d6af1fd66f54363ad8361afb1e6b361/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:00.507025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa5d1-12fc-4964-8b35-dd0b20825307 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.507312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa5d1-12fc-4964-8b35-dd0b20825307 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.507589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fa5d1-12fc-4964-8b35-dd0b20825307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.537622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-200fa5d1-12fc-4964-8b35-dd0b20825307 None None] MFA Rules not processed for user `7d6af1fd66f54363ad8361afb1e6b361`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:00.538865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-200fa5d1-12fc-4964-8b35-dd0b20825307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:00.603792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1316/2627] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:00.608785 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336af0d-e697-47d1-b257-382ded218052 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.672096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336af0d-e697-47d1-b257-382ded218052 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.676670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249fbe2-8a5f-43c3-8905-25b9051f42bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.677276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249fbe2-8a5f-43c3-8905-25b9051f42bb admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.677557 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249fbe2-8a5f-43c3-8905-25b9051f42bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.677862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249fbe2-8a5f-43c3-8905-25b9051f42bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.678496 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249fbe2-8a5f-43c3-8905-25b9051f42bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.680414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249fbe2-8a5f-43c3-8905-25b9051f42bb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.707322 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1312/2628] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:00 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:00.711401 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa5d1-12fc-4964-8b35-dd0b20825307 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.722434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fa5d1-12fc-4964-8b35-dd0b20825307 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.761028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:00.780132 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868dbf-702a-47a8-bf46-883d8f2bd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.780736 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868dbf-702a-47a8-bf46-883d8f2bd7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.781021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868dbf-702a-47a8-bf46-883d8f2bd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.781291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868dbf-702a-47a8-bf46-883d8f2bd7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.781983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868dbf-702a-47a8-bf46-883d8f2bd7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.788728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868dbf-702a-47a8-bf46-883d8f2bd7b7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.816302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1317/2629] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:00 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:00.817540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249fbe2-8a5f-43c3-8905-25b9051f42bb admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.830664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249fbe2-8a5f-43c3-8905-25b9051f42bb admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.835363 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09758f07-375e-4ad0-9e99-d69cb82bd9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.835965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758f07-375e-4ad0-9e99-d69cb82bd9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.836250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758f07-375e-4ad0-9e99-d69cb82bd9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.836524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758f07-375e-4ad0-9e99-d69cb82bd9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.837166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09758f07-375e-4ad0-9e99-d69cb82bd9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.838811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09758f07-375e-4ad0-9e99-d69cb82bd9b6 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.853226 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1313/2630] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:00.857510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868dbf-702a-47a8-bf46-883d8f2bd7b7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.868091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868dbf-702a-47a8-bf46-883d8f2bd7b7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.872701 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bad38-febb-4ae1-9158-42b6c96e1f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.873625 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bad38-febb-4ae1-9158-42b6c96e1f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.873941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bad38-febb-4ae1-9158-42b6c96e1f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.874220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bad38-febb-4ae1-9158-42b6c96e1f94 admin admin] PATH_INFO: `/v3/projects/7c9b065b786f45f7a99bcb1ea5402910/users/c5f4e889a9fb4bf2be7a25d2a8b4ae15/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.888536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bad38-febb-4ae1-9158-42b6c96e1f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9b065b786f45f7a99bcb1ea5402910, user_id=c5f4e889a9fb4bf2be7a25d2a8b4ae15, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.891798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bad38-febb-4ae1-9158-42b6c96e1f94 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.905099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1318/2631] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:00 2022] PUT /identity/v3/projects/7c9b065b786f45f7a99bcb1ea5402910/users/c5f4e889a9fb4bf2be7a25d2a8b4ae15/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:00.909222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09758f07-375e-4ad0-9e99-d69cb82bd9b6 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.919689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09758f07-375e-4ad0-9e99-d69cb82bd9b6 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.923843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:00.979231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6046a7c-3fd4-4768-bda7-8db35ff88a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.979834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046a7c-3fd4-4768-bda7-8db35ff88a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.980138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046a7c-3fd4-4768-bda7-8db35ff88a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.980414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046a7c-3fd4-4768-bda7-8db35ff88a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.981055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6046a7c-3fd4-4768-bda7-8db35ff88a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.982698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6046a7c-3fd4-4768-bda7-8db35ff88a62 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.992603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1314/2632] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:00.996825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bad38-febb-4ae1-9158-42b6c96e1f94 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.007305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bad38-febb-4ae1-9158-42b6c96e1f94 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.011865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.012510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.012787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.013062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] PATH_INFO: `/v3/projects/7c9b065b786f45f7a99bcb1ea5402910/users/c5f4e889a9fb4bf2be7a25d2a8b4ae15/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.015699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9b065b786f45f7a99bcb1ea5402910, user_id=c5f4e889a9fb4bf2be7a25d2a8b4ae15, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.018365 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.028354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1319/2633] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:00 2022] PUT /identity/v3/projects/7c9b065b786f45f7a99bcb1ea5402910/users/c5f4e889a9fb4bf2be7a25d2a8b4ae15/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:01.039907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5e08-e125-4996-808d-dfd9ee402ab9 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.040201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5e08-e125-4996-808d-dfd9ee402ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.040534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5e08-e125-4996-808d-dfd9ee402ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.069129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-414f5e08-e125-4996-808d-dfd9ee402ab9 None None] MFA Rules not processed for user `c5f4e889a9fb4bf2be7a25d2a8b4ae15`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:01.070403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-414f5e08-e125-4996-808d-dfd9ee402ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:01.152565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1315/2634] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:01.163222 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.164924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:01.222360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b6fb-d8a9-46a3-8237-b2e258a637c2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.225898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79174e86-0424-4986-aef3-18dc2777ae20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.226494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174e86-0424-4986-aef3-18dc2777ae20 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.226773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174e86-0424-4986-aef3-18dc2777ae20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.227046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79174e86-0424-4986-aef3-18dc2777ae20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.236034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79174e86-0424-4986-aef3-18dc2777ae20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.237451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79174e86-0424-4986-aef3-18dc2777ae20 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.247433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1320/2635] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:01.350097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5e08-e125-4996-808d-dfd9ee402ab9 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.359698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5e08-e125-4996-808d-dfd9ee402ab9 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.363253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360a5c-ee30-42f6-9f79-1c1344c417b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.363847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360a5c-ee30-42f6-9f79-1c1344c417b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.364125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360a5c-ee30-42f6-9f79-1c1344c417b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.364397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360a5c-ee30-42f6-9f79-1c1344c417b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.422061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0360a5c-ee30-42f6-9f79-1c1344c417b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.423507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0360a5c-ee30-42f6-9f79-1c1344c417b7 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.432266 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1316/2636] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:04.015965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79174e86-0424-4986-aef3-18dc2777ae20 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.077297 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79174e86-0424-4986-aef3-18dc2777ae20 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.081728 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.082370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.082645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.082915 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] PATH_INFO: `/v3/users/7d6af1fd66f54363ad8361afb1e6b361` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.084006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6af1fd66f54363ad8361afb1e6b361)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.085953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:04.126439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:04.137704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6af1fd66f54363ad8361afb1e6b361'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.138560 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6af1fd66f54363ad8361afb1e6b361'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.152262 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6af1fd66f54363ad8361afb1e6b361'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.161232 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6af1fd66f54363ad8361afb1e6b361'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.161926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6af1fd66f54363ad8361afb1e6b361'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.174811 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1321/2637] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:04 2022] DELETE /identity/v3/users/7d6af1fd66f54363ad8361afb1e6b361 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:04.179534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26f9f6-60e3-4226-be42-18296bcfdfbf None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.180025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26f9f6-60e3-4226-be42-18296bcfdfbf None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.180132 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26f9f6-60e3-4226-be42-18296bcfdfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.198983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-fe26f9f6-60e3-4226-be42-18296bcfdfbf None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:04.200185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fe26f9f6-60e3-4226-be42-18296bcfdfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.220301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:04.260822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1317/2638] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:04.270748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.272158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.330012 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a061e-4865-4879-9407-b2b35084d505 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.333696 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169abc75-caf1-4c4e-9e9c-89ba469462b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.334333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169abc75-caf1-4c4e-9e9c-89ba469462b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.334616 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169abc75-caf1-4c4e-9e9c-89ba469462b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.334892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169abc75-caf1-4c4e-9e9c-89ba469462b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.343974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169abc75-caf1-4c4e-9e9c-89ba469462b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.345568 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169abc75-caf1-4c4e-9e9c-89ba469462b1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:04.355037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1322/2639] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:04.632808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26f9f6-60e3-4226-be42-18296bcfdfbf None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.634265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fe26f9f6-60e3-4226-be42-18296bcfdfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.650430 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26f9f6-60e3-4226-be42-18296bcfdfbf None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.662739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.663424 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.663710 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.663987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] PATH_INFO: `/v3/projects/8bcc57b41b7640248cc20a686184ed3b` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.665118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcc57b41b7640248cc20a686184ed3b)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.667061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:04.713092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcc57b41b7640248cc20a686184ed3b', 'request_id': 'req-662c11c3-de9b-403e-b77e-549dbdd1173b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.720899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcc57b41b7640248cc20a686184ed3b', 'request_id': 'req-662c11c3-de9b-403e-b77e-549dbdd1173b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.728590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcc57b41b7640248cc20a686184ed3b', 'request_id': 'req-662c11c3-de9b-403e-b77e-549dbdd1173b'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.743166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] The token cache is being invalidate because project 8bcc57b41b7640248cc20a686184ed3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:04.743457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.744108 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.745586 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1318/2640] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:04 2022] DELETE /identity/v3/projects/8bcc57b41b7640248cc20a686184ed3b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:04.750248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169abc75-caf1-4c4e-9e9c-89ba469462b1 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.759751 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169abc75-caf1-4c4e-9e9c-89ba469462b1 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.819944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.820495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.820776 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.821050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] PATH_INFO: `/v3/users/c5f4e889a9fb4bf2be7a25d2a8b4ae15` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.822300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f4e889a9fb4bf2be7a25d2a8b4ae15)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.824220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:04.869949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f4e889a9fb4bf2be7a25d2a8b4ae15'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.870605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f4e889a9fb4bf2be7a25d2a8b4ae15'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.878957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:04.883884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f4e889a9fb4bf2be7a25d2a8b4ae15'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.892091 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f4e889a9fb4bf2be7a25d2a8b4ae15'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.892777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dd08ced6-7e1f-4d3e-b5dc-ee8b1ba674ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f4e889a9fb4bf2be7a25d2a8b4ae15'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.905171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1323/2641] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:04 2022] DELETE /identity/v3/users/c5f4e889a9fb4bf2be7a25d2a8b4ae15 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:05.182690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.186243 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.200169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c11c3-de9b-403e-b77e-549dbdd1173b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.269887 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.270529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.270811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.271077 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] PATH_INFO: `/v3/projects/7c9b065b786f45f7a99bcb1ea5402910` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.272193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9b065b786f45f7a99bcb1ea5402910)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.274201 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.321365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9b065b786f45f7a99bcb1ea5402910', 'request_id': 'req-dc66980e-219b-44b2-8d43-012b5d527e20'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.323306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:05.328125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9b065b786f45f7a99bcb1ea5402910', 'request_id': 'req-dc66980e-219b-44b2-8d43-012b5d527e20'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.335834 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9b065b786f45f7a99bcb1ea5402910', 'request_id': 'req-dc66980e-219b-44b2-8d43-012b5d527e20'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.347697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] The token cache is being invalidate because project 7c9b065b786f45f7a99bcb1ea5402910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:05.347904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.348562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-dc66980e-219b-44b2-8d43-012b5d527e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.350098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1319/2642] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:05 2022] DELETE /identity/v3/projects/7c9b065b786f45f7a99bcb1ea5402910 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:05.355081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9ef6f-d94a-46b3-a232-b48a94764b5a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.355590 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9ef6f-d94a-46b3-a232-b48a94764b5a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.355697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9ef6f-d94a-46b3-a232-b48a94764b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.376127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d3a9ef6f-d94a-46b3-a232-b48a94764b5a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:05.377322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d3a9ef6f-d94a-46b3-a232-b48a94764b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.436720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1324/2643] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:05.446125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080514b7-c10e-4a60-8079-5299f7496c4c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.446410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080514b7-c10e-4a60-8079-5299f7496c4c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.446685 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080514b7-c10e-4a60-8079-5299f7496c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.469306 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-080514b7-c10e-4a60-8079-5299f7496c4c None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:05.470670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-080514b7-c10e-4a60-8079-5299f7496c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.480587 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1320/2644] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:05.485763 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9ef6f-d94a-46b3-a232-b48a94764b5a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.495911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9ef6f-d94a-46b3-a232-b48a94764b5a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.501210 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.501806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.502119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.502394 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.503035 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:05.503336 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.504936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.516785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1325/2645] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:47:05.521037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080514b7-c10e-4a60-8079-5299f7496c4c None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.530622 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080514b7-c10e-4a60-8079-5299f7496c4c None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.535173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e04c-3309-4a59-950b-49120615a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.535763 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e04c-3309-4a59-950b-49120615a6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.536039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e04c-3309-4a59-950b-49120615a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.536307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e04c-3309-4a59-950b-49120615a6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.536916 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034e04c-3309-4a59-950b-49120615a6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.538839 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034e04c-3309-4a59-950b-49120615a6dd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.566680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1321/2646] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:05.570791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.580730 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eec070-8220-4451-9f18-2bff9c7f2f36 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.640535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0e1-f89d-4ebd-a8a7-2ad334be9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.641061 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0e1-f89d-4ebd-a8a7-2ad334be9fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.641340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0e1-f89d-4ebd-a8a7-2ad334be9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.641613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0e1-f89d-4ebd-a8a7-2ad334be9fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.642272 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a0e1-f89d-4ebd-a8a7-2ad334be9fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.644191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a0e1-f89d-4ebd-a8a7-2ad334be9fd3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.665038 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1326/2647] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:05.669314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e04c-3309-4a59-950b-49120615a6dd admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.679799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e04c-3309-4a59-950b-49120615a6dd admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.684337 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e7af-e72d-4404-bd6c-46348b6dac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.684928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e7af-e72d-4404-bd6c-46348b6dac98 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.685199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e7af-e72d-4404-bd6c-46348b6dac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.685467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e7af-e72d-4404-bd6c-46348b6dac98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.686927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649e7af-e72d-4404-bd6c-46348b6dac98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.688522 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649e7af-e72d-4404-bd6c-46348b6dac98 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.698263 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1322/2648] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:05.702755 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0e1-f89d-4ebd-a8a7-2ad334be9fd3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.712778 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0e1-f89d-4ebd-a8a7-2ad334be9fd3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.717720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e3ec0-fb1d-4973-8f07-2a7d48389f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.718395 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3ec0-fb1d-4973-8f07-2a7d48389f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.718831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3ec0-fb1d-4973-8f07-2a7d48389f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.718992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3ec0-fb1d-4973-8f07-2a7d48389f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.719578 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e3ec0-fb1d-4973-8f07-2a7d48389f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.721162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e3ec0-fb1d-4973-8f07-2a7d48389f6f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.731515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1327/2649] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:05.735754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e7af-e72d-4404-bd6c-46348b6dac98 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.746114 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e7af-e72d-4404-bd6c-46348b6dac98 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.751393 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c24d6-12a9-4975-9376-a3439b887b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.752202 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c24d6-12a9-4975-9376-a3439b887b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.752489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c24d6-12a9-4975-9376-a3439b887b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.752765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c24d6-12a9-4975-9376-a3439b887b24 admin admin] PATH_INFO: `/v3/projects/fb12a2548ecd4c9a9feb31e5d63ff369/users/91ed56ba1fd34fd88f39410a6c2408f9/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.768066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c24d6-12a9-4975-9376-a3439b887b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb12a2548ecd4c9a9feb31e5d63ff369, user_id=91ed56ba1fd34fd88f39410a6c2408f9, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.770792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c24d6-12a9-4975-9376-a3439b887b24 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.783853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1323/2650] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:05 2022] PUT /identity/v3/projects/fb12a2548ecd4c9a9feb31e5d63ff369/users/91ed56ba1fd34fd88f39410a6c2408f9/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:05.794074 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f07e09-5134-42b5-99c8-ceec5f9c03a5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.794358 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f07e09-5134-42b5-99c8-ceec5f9c03a5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.794632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f07e09-5134-42b5-99c8-ceec5f9c03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.821725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f5f07e09-5134-42b5-99c8-ceec5f9c03a5 None None] MFA Rules not processed for user `91ed56ba1fd34fd88f39410a6c2408f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:05.822997 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f5f07e09-5134-42b5-99c8-ceec5f9c03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.852426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:05.889715 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1328/2651] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:05.894410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c24d6-12a9-4975-9376-a3439b887b24 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.958811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c24d6-12a9-4975-9376-a3439b887b24 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.964061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10027d1-f92d-427a-8f5c-79786616c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.964882 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10027d1-f92d-427a-8f5c-79786616c376 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.965221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10027d1-f92d-427a-8f5c-79786616c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.965495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10027d1-f92d-427a-8f5c-79786616c376 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.966161 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10027d1-f92d-427a-8f5c-79786616c376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.968847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10027d1-f92d-427a-8f5c-79786616c376 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.995151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1324/2652] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:05.999462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f07e09-5134-42b5-99c8-ceec5f9c03a5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.010078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f07e09-5134-42b5-99c8-ceec5f9c03a5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.067199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ebfe-60a0-44ca-8d8c-9da80bb9bf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.067835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ebfe-60a0-44ca-8d8c-9da80bb9bf06 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.068119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ebfe-60a0-44ca-8d8c-9da80bb9bf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.068392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ebfe-60a0-44ca-8d8c-9da80bb9bf06 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.069044 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ebfe-60a0-44ca-8d8c-9da80bb9bf06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.071021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ebfe-60a0-44ca-8d8c-9da80bb9bf06 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.093050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1329/2653] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:06.097007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10027d1-f92d-427a-8f5c-79786616c376 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.107392 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10027d1-f92d-427a-8f5c-79786616c376 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.112881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d10094-c19a-4776-93f2-50cf20f6ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.113474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10094-c19a-4776-93f2-50cf20f6ff8b admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.113751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10094-c19a-4776-93f2-50cf20f6ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.114056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d10094-c19a-4776-93f2-50cf20f6ff8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.114695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d10094-c19a-4776-93f2-50cf20f6ff8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.116310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d10094-c19a-4776-93f2-50cf20f6ff8b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.128005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1325/2654] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:06.132059 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ebfe-60a0-44ca-8d8c-9da80bb9bf06 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.143164 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ebfe-60a0-44ca-8d8c-9da80bb9bf06 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.147864 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730b15a-e59e-4444-bb8e-a9ac0bdc4f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.148407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730b15a-e59e-4444-bb8e-a9ac0bdc4f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.148686 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730b15a-e59e-4444-bb8e-a9ac0bdc4f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.148958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730b15a-e59e-4444-bb8e-a9ac0bdc4f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.149601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730b15a-e59e-4444-bb8e-a9ac0bdc4f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.151231 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730b15a-e59e-4444-bb8e-a9ac0bdc4f88 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.161816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1330/2655] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:06.166028 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d10094-c19a-4776-93f2-50cf20f6ff8b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.176697 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d10094-c19a-4776-93f2-50cf20f6ff8b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.181307 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c575f-45d2-4265-9675-afb3c9413c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.181987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c575f-45d2-4265-9675-afb3c9413c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.182270 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c575f-45d2-4265-9675-afb3c9413c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.182553 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c575f-45d2-4265-9675-afb3c9413c18 admin admin] PATH_INFO: `/v3/projects/a949fa37f76248928349b4f6461a18e6/users/17428900a4de441283f9c74eb77bb47c/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.197632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c575f-45d2-4265-9675-afb3c9413c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a949fa37f76248928349b4f6461a18e6, user_id=17428900a4de441283f9c74eb77bb47c, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.200315 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c575f-45d2-4265-9675-afb3c9413c18 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.214794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1326/2656] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:06 2022] PUT /identity/v3/projects/a949fa37f76248928349b4f6461a18e6/users/17428900a4de441283f9c74eb77bb47c/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:06.226457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29832-86ea-4d24-80d6-02e16f78ba8d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.226739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29832-86ea-4d24-80d6-02e16f78ba8d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.227028 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b29832-86ea-4d24-80d6-02e16f78ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.256227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-50b29832-86ea-4d24-80d6-02e16f78ba8d None None] MFA Rules not processed for user `17428900a4de441283f9c74eb77bb47c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:06.257443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-50b29832-86ea-4d24-80d6-02e16f78ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:06.320331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1331/2657] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:06.324946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c575f-45d2-4265-9675-afb3c9413c18 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.354733 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:06.390526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c575f-45d2-4265-9675-afb3c9413c18 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.395549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167ebfc-b106-4cc8-9d42-1d6d89143994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.396160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ebfc-b106-4cc8-9d42-1d6d89143994 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.396443 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ebfc-b106-4cc8-9d42-1d6d89143994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.396717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167ebfc-b106-4cc8-9d42-1d6d89143994 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.397350 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167ebfc-b106-4cc8-9d42-1d6d89143994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.399340 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167ebfc-b106-4cc8-9d42-1d6d89143994 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.425810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1327/2658] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:06 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:06.429996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b29832-86ea-4d24-80d6-02e16f78ba8d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.441353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b29832-86ea-4d24-80d6-02e16f78ba8d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.478785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:06.498787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b909d7-54ee-48ee-84f0-17673de6de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.499392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b909d7-54ee-48ee-84f0-17673de6de0c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.499671 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b909d7-54ee-48ee-84f0-17673de6de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.499946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b909d7-54ee-48ee-84f0-17673de6de0c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.500564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b909d7-54ee-48ee-84f0-17673de6de0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.502528 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b909d7-54ee-48ee-84f0-17673de6de0c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.525954 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1332/2659] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:06 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:06.529323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167ebfc-b106-4cc8-9d42-1d6d89143994 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.539589 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167ebfc-b106-4cc8-9d42-1d6d89143994 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.544230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ef571-faf3-4c69-92c3-58a29b02cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.544828 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef571-faf3-4c69-92c3-58a29b02cb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.545245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef571-faf3-4c69-92c3-58a29b02cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.545521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef571-faf3-4c69-92c3-58a29b02cb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.546223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ef571-faf3-4c69-92c3-58a29b02cb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.547815 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ef571-faf3-4c69-92c3-58a29b02cb5c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.558223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1328/2660] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:06.562964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b909d7-54ee-48ee-84f0-17673de6de0c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.573094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b909d7-54ee-48ee-84f0-17673de6de0c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.579116 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92126-304f-4205-85cb-c896194104c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.579876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92126-304f-4205-85cb-c896194104c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.580378 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92126-304f-4205-85cb-c896194104c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.580504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92126-304f-4205-85cb-c896194104c9 admin admin] PATH_INFO: `/v3/projects/bd9c9f9df2ca4542ac85383049ec9cb9/users/111adcbbfb9841089cf00d5ed786ec0d/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.596053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da92126-304f-4205-85cb-c896194104c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9c9f9df2ca4542ac85383049ec9cb9, user_id=111adcbbfb9841089cf00d5ed786ec0d, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.598830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da92126-304f-4205-85cb-c896194104c9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.611300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1333/2661] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:06 2022] PUT /identity/v3/projects/bd9c9f9df2ca4542ac85383049ec9cb9/users/111adcbbfb9841089cf00d5ed786ec0d/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:06.615205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ef571-faf3-4c69-92c3-58a29b02cb5c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.626389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ef571-faf3-4c69-92c3-58a29b02cb5c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.681603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755e642-fe64-4c68-a7bb-1040f16df90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.682166 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e642-fe64-4c68-a7bb-1040f16df90a admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.682450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e642-fe64-4c68-a7bb-1040f16df90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.682725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e642-fe64-4c68-a7bb-1040f16df90a admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.683360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755e642-fe64-4c68-a7bb-1040f16df90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.684957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755e642-fe64-4c68-a7bb-1040f16df90a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.695222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1329/2662] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:06.699304 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92126-304f-4205-85cb-c896194104c9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.710182 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da92126-304f-4205-85cb-c896194104c9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.714683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.715326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.715600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.715871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] PATH_INFO: `/v3/projects/bd9c9f9df2ca4542ac85383049ec9cb9/users/111adcbbfb9841089cf00d5ed786ec0d/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.718601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9c9f9df2ca4542ac85383049ec9cb9, user_id=111adcbbfb9841089cf00d5ed786ec0d, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.721206 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.731129 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1334/2663] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:06 2022] PUT /identity/v3/projects/bd9c9f9df2ca4542ac85383049ec9cb9/users/111adcbbfb9841089cf00d5ed786ec0d/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:06.742268 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a6833-4e59-459b-bd75-ac597240a745 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.742556 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a6833-4e59-459b-bd75-ac597240a745 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.742833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a6833-4e59-459b-bd75-ac597240a745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.770404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-799a6833-4e59-459b-bd75-ac597240a745 None None] MFA Rules not processed for user `111adcbbfb9841089cf00d5ed786ec0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:06.771604 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-799a6833-4e59-459b-bd75-ac597240a745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:06.838246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1330/2664] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:06.850857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.852552 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:06.910928 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f48c4-c263-4798-a46a-c703a3e4feb0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.914507 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c65e1-e72b-4160-8ff2-38a100d461f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.915107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c65e1-e72b-4160-8ff2-38a100d461f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.915385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c65e1-e72b-4160-8ff2-38a100d461f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.915653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c65e1-e72b-4160-8ff2-38a100d461f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.925033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c65e1-e72b-4160-8ff2-38a100d461f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.926524 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c65e1-e72b-4160-8ff2-38a100d461f3 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.936170 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1335/2665] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:06.977469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a6833-4e59-459b-bd75-ac597240a745 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.978889 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-799a6833-4e59-459b-bd75-ac597240a745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:06.991862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a6833-4e59-459b-bd75-ac597240a745 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.995503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2497ac-e72f-4f01-9471-b7d3f1290d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.996094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2497ac-e72f-4f01-9471-b7d3f1290d21 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.996375 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2497ac-e72f-4f01-9471-b7d3f1290d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.996649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2497ac-e72f-4f01-9471-b7d3f1290d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:07.017022 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:07.055804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2497ac-e72f-4f01-9471-b7d3f1290d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:07.057275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2497ac-e72f-4f01-9471-b7d3f1290d21 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:07.066818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1331/2666] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:09.956618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c65e1-e72b-4160-8ff2-38a100d461f3 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:10.016905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c65e1-e72b-4160-8ff2-38a100d461f3 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:10.021305 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:10.021976 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.022253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.022523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] PATH_INFO: `/v3/users/91ed56ba1fd34fd88f39410a6c2408f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.023619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ed56ba1fd34fd88f39410a6c2408f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:10.025505 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:10.064473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:10.074235 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ed56ba1fd34fd88f39410a6c2408f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.074888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ed56ba1fd34fd88f39410a6c2408f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.087295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ed56ba1fd34fd88f39410a6c2408f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.094418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ed56ba1fd34fd88f39410a6c2408f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.095033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ed56ba1fd34fd88f39410a6c2408f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.106911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1336/2667] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:09 2022] DELETE /identity/v3/users/91ed56ba1fd34fd88f39410a6c2408f9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:10.111669 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab122e-a442-46f1-a282-1343fb717681 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.112175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab122e-a442-46f1-a282-1343fb717681 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.112276 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab122e-a442-46f1-a282-1343fb717681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.131938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b7ab122e-a442-46f1-a282-1343fb717681 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:10.133167 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b7ab122e-a442-46f1-a282-1343fb717681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:10.194133 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1332/2668] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:10.204363 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:10.205780 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:10.263005 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c70f-fb49-4661-bcb0-a2d89a03f282 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:10.267219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9175f-dceb-4fa1-957b-d69fbed30abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:10.267821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9175f-dceb-4fa1-957b-d69fbed30abf service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.268101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9175f-dceb-4fa1-957b-d69fbed30abf service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.268376 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9175f-dceb-4fa1-957b-d69fbed30abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.277103 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9175f-dceb-4fa1-957b-d69fbed30abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:10.278569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9175f-dceb-4fa1-957b-d69fbed30abf service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:10.288427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1337/2669] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:10.562538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab122e-a442-46f1-a282-1343fb717681 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:10.563979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b7ab122e-a442-46f1-a282-1343fb717681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:10.578285 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab122e-a442-46f1-a282-1343fb717681 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:10.583534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:10.584533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.584884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.585080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] PATH_INFO: `/v3/projects/fb12a2548ecd4c9a9feb31e5d63ff369` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.586403 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb12a2548ecd4c9a9feb31e5d63ff369)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:10.588362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:10.639149 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb12a2548ecd4c9a9feb31e5d63ff369', 'request_id': 'req-61d3d629-b245-4abc-be69-0d6ca0909c3f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.644442 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb12a2548ecd4c9a9feb31e5d63ff369', 'request_id': 'req-61d3d629-b245-4abc-be69-0d6ca0909c3f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.651614 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb12a2548ecd4c9a9feb31e5d63ff369', 'request_id': 'req-61d3d629-b245-4abc-be69-0d6ca0909c3f'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.662983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] The token cache is being invalidate because project fb12a2548ecd4c9a9feb31e5d63ff369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:10.663267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.663881 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.665420 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1333/2670] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:10 2022] DELETE /identity/v3/projects/fb12a2548ecd4c9a9feb31e5d63ff369 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:10.669382 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9175f-dceb-4fa1-957b-d69fbed30abf service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:10.680090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9175f-dceb-4fa1-957b-d69fbed30abf service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:10.736906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:10.737460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.737742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.738050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] PATH_INFO: `/v3/users/17428900a4de441283f9c74eb77bb47c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.739159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17428900a4de441283f9c74eb77bb47c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:10.741133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:10.787314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17428900a4de441283f9c74eb77bb47c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.787948 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17428900a4de441283f9c74eb77bb47c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.795918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:10.801122 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17428900a4de441283f9c74eb77bb47c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.808672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17428900a4de441283f9c74eb77bb47c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.809330 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17428900a4de441283f9c74eb77bb47c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:10.822452 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1338/2671] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:10 2022] DELETE /identity/v3/users/17428900a4de441283f9c74eb77bb47c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:11.097269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:11.098865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:11.116235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3d629-b245-4abc-be69-0d6ca0909c3f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:11.164083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:11.180659 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:11.181293 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:11.181579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:11.181892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] PATH_INFO: `/v3/projects/a949fa37f76248928349b4f6461a18e6` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:11.183005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a949fa37f76248928349b4f6461a18e6)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:11.184919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:11.231534 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a949fa37f76248928349b4f6461a18e6', 'request_id': 'req-e6019be1-6626-4cc2-8b34-48bc64d1ed81'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.237908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a949fa37f76248928349b4f6461a18e6', 'request_id': 'req-e6019be1-6626-4cc2-8b34-48bc64d1ed81'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.245520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a949fa37f76248928349b4f6461a18e6', 'request_id': 'req-e6019be1-6626-4cc2-8b34-48bc64d1ed81'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.257250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] The token cache is being invalidate because project a949fa37f76248928349b4f6461a18e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:11.257555 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.258195 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.259674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1334/2672] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:11 2022] DELETE /identity/v3/projects/a949fa37f76248928349b4f6461a18e6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:11.264346 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:11.266030 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:11.278666 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726c88b-ba70-4a18-b943-c36444bc9aa8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:11.337653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:11.338319 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:11.338607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:11.338880 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] PATH_INFO: `/v3/users/111adcbbfb9841089cf00d5ed786ec0d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:11.339992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111adcbbfb9841089cf00d5ed786ec0d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:11.342542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:11.386860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111adcbbfb9841089cf00d5ed786ec0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.387537 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111adcbbfb9841089cf00d5ed786ec0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.400220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111adcbbfb9841089cf00d5ed786ec0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.409039 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111adcbbfb9841089cf00d5ed786ec0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.409772 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16dad92d-6e55-4802-8067-656c638c3010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111adcbbfb9841089cf00d5ed786ec0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.422198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1339/2673] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:11 2022] DELETE /identity/v3/users/111adcbbfb9841089cf00d5ed786ec0d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:11.700415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:11.702319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:11.719913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019be1-6626-4cc2-8b34-48bc64d1ed81 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:11.776444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:11.777069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:11.777348 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:11.777617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] PATH_INFO: `/v3/projects/bd9c9f9df2ca4542ac85383049ec9cb9` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:11.778737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9c9f9df2ca4542ac85383049ec9cb9)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:11.781535 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:11.828309 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9c9f9df2ca4542ac85383049ec9cb9', 'request_id': 'req-b7022e62-e1b9-475e-8b51-cae01a796f09'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.833802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9c9f9df2ca4542ac85383049ec9cb9', 'request_id': 'req-b7022e62-e1b9-475e-8b51-cae01a796f09'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.840819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9c9f9df2ca4542ac85383049ec9cb9', 'request_id': 'req-b7022e62-e1b9-475e-8b51-cae01a796f09'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.852013 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] The token cache is being invalidate because project bd9c9f9df2ca4542ac85383049ec9cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:11.852296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.853007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b7022e62-e1b9-475e-8b51-cae01a796f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:11.854500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1335/2674] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:11 2022] DELETE /identity/v3/projects/bd9c9f9df2ca4542ac85383049ec9cb9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:11.860582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80560f-5754-4049-bff7-2ea3aa11e1fc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:11.860871 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80560f-5754-4049-bff7-2ea3aa11e1fc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:11.861151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80560f-5754-4049-bff7-2ea3aa11e1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:11.881422 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fe80560f-5754-4049-bff7-2ea3aa11e1fc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:11.882677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fe80560f-5754-4049-bff7-2ea3aa11e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:11.935400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:11.948698 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1340/2675] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:11.957521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60450-3180-4437-bed9-ccd7c5bae542 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:11.957811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60450-3180-4437-bed9-ccd7c5bae542 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:11.958118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60450-3180-4437-bed9-ccd7c5bae542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:11.973106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:11.979190 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-bfa60450-3180-4437-bed9-ccd7c5bae542 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:11.981339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-bfa60450-3180-4437-bed9-ccd7c5bae542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:11.990705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1336/2676] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:11.995215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80560f-5754-4049-bff7-2ea3aa11e1fc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.005640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80560f-5754-4049-bff7-2ea3aa11e1fc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.010274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.010875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.011162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.011437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.012081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:12.012389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.014551 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.025958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1341/2677] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:12.030976 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa60450-3180-4437-bed9-ccd7c5bae542 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.040248 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa60450-3180-4437-bed9-ccd7c5bae542 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.045417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3494120-3c38-4ed2-953e-f91b64ce1944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.046228 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3494120-3c38-4ed2-953e-f91b64ce1944 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.046513 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3494120-3c38-4ed2-953e-f91b64ce1944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.046790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3494120-3c38-4ed2-953e-f91b64ce1944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.047417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3494120-3c38-4ed2-953e-f91b64ce1944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.049451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3494120-3c38-4ed2-953e-f91b64ce1944 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.076389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1337/2678] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:12 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:12.081046 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.090765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9632a-7bef-4fa7-a236-730498dda390 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.147606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd78ee-bc23-42cd-80b7-9214f4c23d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.148205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd78ee-bc23-42cd-80b7-9214f4c23d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.148495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd78ee-bc23-42cd-80b7-9214f4c23d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.148756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd78ee-bc23-42cd-80b7-9214f4c23d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.149384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd78ee-bc23-42cd-80b7-9214f4c23d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.151354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd78ee-bc23-42cd-80b7-9214f4c23d9c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.172848 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1342/2679] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:12 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:12.177183 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3494120-3c38-4ed2-953e-f91b64ce1944 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.187600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3494120-3c38-4ed2-953e-f91b64ce1944 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.192330 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ff770-1b1c-463d-8e32-819c6f43a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.192932 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ff770-1b1c-463d-8e32-819c6f43a94b admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.193217 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ff770-1b1c-463d-8e32-819c6f43a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.193495 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ff770-1b1c-463d-8e32-819c6f43a94b admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.194191 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ff770-1b1c-463d-8e32-819c6f43a94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.195810 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ff770-1b1c-463d-8e32-819c6f43a94b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.211023 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1338/2680] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:12.215137 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd78ee-bc23-42cd-80b7-9214f4c23d9c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.225996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd78ee-bc23-42cd-80b7-9214f4c23d9c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.230922 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2d77-c5c7-4ead-9655-4f6f71e9b581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.231516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2d77-c5c7-4ead-9655-4f6f71e9b581 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.231798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2d77-c5c7-4ead-9655-4f6f71e9b581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.232072 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2d77-c5c7-4ead-9655-4f6f71e9b581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.232967 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c2d77-c5c7-4ead-9655-4f6f71e9b581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.234631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c2d77-c5c7-4ead-9655-4f6f71e9b581 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.245909 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1343/2681] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:12.250002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ff770-1b1c-463d-8e32-819c6f43a94b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.260332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ff770-1b1c-463d-8e32-819c6f43a94b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.266110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.267174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.267668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.268169 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] PATH_INFO: `/v3/projects/0e139d0659964fe386ff9f0bd2639d26/users/94ca240e4aa24a629c9c00c780aca061/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.287958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e139d0659964fe386ff9f0bd2639d26, user_id=94ca240e4aa24a629c9c00c780aca061, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.290653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.306230 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1339/2682] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:12 2022] PUT /identity/v3/projects/0e139d0659964fe386ff9f0bd2639d26/users/94ca240e4aa24a629c9c00c780aca061/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:12.321014 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6fac6-8f54-4b5f-9c9e-e4c6afc82fb9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.321515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6fac6-8f54-4b5f-9c9e-e4c6afc82fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.321614 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6fac6-8f54-4b5f-9c9e-e4c6afc82fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.349889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2bd6fac6-8f54-4b5f-9c9e-e4c6afc82fb9 None None] MFA Rules not processed for user `94ca240e4aa24a629c9c00c780aca061`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:12.351042 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2bd6fac6-8f54-4b5f-9c9e-e4c6afc82fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:12.414839 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1344/2683] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:12.426382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.428112 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:12.485600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4e53e-015b-4132-9af5-72378372a25b admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.489540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e029ff-894e-4a6e-b539-2f83973afc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.490182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e029ff-894e-4a6e-b539-2f83973afc71 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.490468 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e029ff-894e-4a6e-b539-2f83973afc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.490744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e029ff-894e-4a6e-b539-2f83973afc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.500018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e029ff-894e-4a6e-b539-2f83973afc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.501458 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e029ff-894e-4a6e-b539-2f83973afc71 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.510605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1340/2684] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:12.532989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6fac6-8f54-4b5f-9c9e-e4c6afc82fb9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.586037 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:12.599246 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6fac6-8f54-4b5f-9c9e-e4c6afc82fb9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.604090 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.604664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.604945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.605219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] PATH_INFO: `/v3/users/94ca240e4aa24a629c9c00c780aca061` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.606385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ca240e4aa24a629c9c00c780aca061)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.609203 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.664420 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ca240e4aa24a629c9c00c780aca061'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.665109 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ca240e4aa24a629c9c00c780aca061'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.679199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ca240e4aa24a629c9c00c780aca061'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.687332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ca240e4aa24a629c9c00c780aca061'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.687973 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ca240e4aa24a629c9c00c780aca061'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.700023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1345/2685] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:12 2022] DELETE /identity/v3/users/94ca240e4aa24a629c9c00c780aca061 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:12.704845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5cd06-103b-4c38-a6ac-a2398569d514 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.705135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5cd06-103b-4c38-a6ac-a2398569d514 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.705415 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5cd06-103b-4c38-a6ac-a2398569d514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.725624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-c1a5cd06-103b-4c38-a6ac-a2398569d514 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:12.726844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c1a5cd06-103b-4c38-a6ac-a2398569d514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:12.785080 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1341/2686] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:12.795372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.796892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:12.854667 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1f010-0915-4114-82d9-cc873c202062 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.858934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263f25-06cb-4b80-8016-354a179fec9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.859534 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263f25-06cb-4b80-8016-354a179fec9f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.859814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263f25-06cb-4b80-8016-354a179fec9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.860086 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263f25-06cb-4b80-8016-354a179fec9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.869205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263f25-06cb-4b80-8016-354a179fec9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.870664 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263f25-06cb-4b80-8016-354a179fec9f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.880677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1346/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:13.153888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5cd06-103b-4c38-a6ac-a2398569d514 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.156118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c1a5cd06-103b-4c38-a6ac-a2398569d514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:13.174174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5cd06-103b-4c38-a6ac-a2398569d514 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.179470 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.180328 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.180774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.181267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] PATH_INFO: `/v3/projects/0e139d0659964fe386ff9f0bd2639d26` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.182709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e139d0659964fe386ff9f0bd2639d26)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.184663 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.225637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:13.234218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e139d0659964fe386ff9f0bd2639d26', 'request_id': 'req-5d59bade-69be-41df-8b1b-56b5495f9913'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.240364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e139d0659964fe386ff9f0bd2639d26', 'request_id': 'req-5d59bade-69be-41df-8b1b-56b5495f9913'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.248411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e139d0659964fe386ff9f0bd2639d26', 'request_id': 'req-5d59bade-69be-41df-8b1b-56b5495f9913'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.259909 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] The token cache is being invalidate because project 0e139d0659964fe386ff9f0bd2639d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:13.260203 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.260837 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-5d59bade-69be-41df-8b1b-56b5495f9913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.262361 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1342/2688] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:13 2022] DELETE /identity/v3/projects/0e139d0659964fe386ff9f0bd2639d26 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:13.268461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192321f-bb61-4fc2-8533-0699c4bdfc7b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.268749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192321f-bb61-4fc2-8533-0699c4bdfc7b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.269029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192321f-bb61-4fc2-8533-0699c4bdfc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.288963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7192321f-bb61-4fc2-8533-0699c4bdfc7b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:13.290225 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7192321f-bb61-4fc2-8533-0699c4bdfc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:13.351187 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1347/2689] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:13.359584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9367-b608-4bf2-a9f5-ff6c5ffe9f19 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.359901 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9367-b608-4bf2-a9f5-ff6c5ffe9f19 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.360179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9367-b608-4bf2-a9f5-ff6c5ffe9f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.379608 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-ab7e9367-b608-4bf2-a9f5-ff6c5ffe9f19 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:13.380741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ab7e9367-b608-4bf2-a9f5-ff6c5ffe9f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:13.388582 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1343/2690] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:13.393191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192321f-bb61-4fc2-8533-0699c4bdfc7b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.402974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192321f-bb61-4fc2-8533-0699c4bdfc7b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.408384 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.409012 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.409280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.409559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.410250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:13.410559 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.412158 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.421532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:13.428128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1348/2691] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:13.429606 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e9367-b608-4bf2-a9f5-ff6c5ffe9f19 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.439069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e9367-b608-4bf2-a9f5-ff6c5ffe9f19 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.443717 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cf40-ac13-47ff-a248-1e73fe0277fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.444312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cf40-ac13-47ff-a248-1e73fe0277fd admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.444590 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cf40-ac13-47ff-a248-1e73fe0277fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.444862 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cf40-ac13-47ff-a248-1e73fe0277fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.445519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cf40-ac13-47ff-a248-1e73fe0277fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.447464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cf40-ac13-47ff-a248-1e73fe0277fd admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.475239 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1344/2692] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:13 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:13.479487 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.490019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcd11a-1a78-4017-8dc1-d6b2561c1c29 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.545946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d2ded-f090-4f39-9053-1b2d9ad03894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.546555 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d2ded-f090-4f39-9053-1b2d9ad03894 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.546865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d2ded-f090-4f39-9053-1b2d9ad03894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.547141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d2ded-f090-4f39-9053-1b2d9ad03894 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.547756 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d2ded-f090-4f39-9053-1b2d9ad03894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.549675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d2ded-f090-4f39-9053-1b2d9ad03894 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.571902 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1349/2693] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:13 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:13.576702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cf40-ac13-47ff-a248-1e73fe0277fd admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.587152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cf40-ac13-47ff-a248-1e73fe0277fd admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.592333 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5de6-3567-49d0-a136-ff90735222b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.592975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5de6-3567-49d0-a136-ff90735222b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.593258 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5de6-3567-49d0-a136-ff90735222b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.593528 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f5de6-3567-49d0-a136-ff90735222b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.594212 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f5de6-3567-49d0-a136-ff90735222b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.595816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f5de6-3567-49d0-a136-ff90735222b7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.605538 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1345/2694] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:13.610191 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d2ded-f090-4f39-9053-1b2d9ad03894 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.620554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d2ded-f090-4f39-9053-1b2d9ad03894 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.626952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec642f1-73a3-48da-9a28-e67aba61f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.627738 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec642f1-73a3-48da-9a28-e67aba61f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.628008 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec642f1-73a3-48da-9a28-e67aba61f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.628288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec642f1-73a3-48da-9a28-e67aba61f7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.628924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec642f1-73a3-48da-9a28-e67aba61f7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.630626 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec642f1-73a3-48da-9a28-e67aba61f7dd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.643250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1350/2695] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:13.647386 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5de6-3567-49d0-a136-ff90735222b7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.658012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f5de6-3567-49d0-a136-ff90735222b7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.662653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23ea2e-bd35-41f8-a7c1-030224d0250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.663290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23ea2e-bd35-41f8-a7c1-030224d0250e admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.663567 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23ea2e-bd35-41f8-a7c1-030224d0250e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.663843 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23ea2e-bd35-41f8-a7c1-030224d0250e admin admin] PATH_INFO: `/v3/projects/48abc10791c14e8786d21dcf30ab4a11/users/ea73982e46ff47a689d1abe1f4bbd4d8/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.678512 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23ea2e-bd35-41f8-a7c1-030224d0250e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48abc10791c14e8786d21dcf30ab4a11, user_id=ea73982e46ff47a689d1abe1f4bbd4d8, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.681151 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23ea2e-bd35-41f8-a7c1-030224d0250e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.694682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1346/2696] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:13 2022] PUT /identity/v3/projects/48abc10791c14e8786d21dcf30ab4a11/users/ea73982e46ff47a689d1abe1f4bbd4d8/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:13.705497 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4f3bf-d452-41fa-81e3-988f4bf03a49 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.705784 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4f3bf-d452-41fa-81e3-988f4bf03a49 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.706094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4f3bf-d452-41fa-81e3-988f4bf03a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.733258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7af4f3bf-d452-41fa-81e3-988f4bf03a49 None None] MFA Rules not processed for user `ea73982e46ff47a689d1abe1f4bbd4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:13.734518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7af4f3bf-d452-41fa-81e3-988f4bf03a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:13.797731 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1351/2697] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:13.802185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23ea2e-bd35-41f8-a7c1-030224d0250e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.864037 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23ea2e-bd35-41f8-a7c1-030224d0250e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.868984 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ad8b5-420d-42a3-90d9-9c02ce279d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.869585 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ad8b5-420d-42a3-90d9-9c02ce279d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.869894 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ad8b5-420d-42a3-90d9-9c02ce279d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.870174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ad8b5-420d-42a3-90d9-9c02ce279d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.870802 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ad8b5-420d-42a3-90d9-9c02ce279d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.872707 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ad8b5-420d-42a3-90d9-9c02ce279d7c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.900259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1347/2698] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:13 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:13.904321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4f3bf-d452-41fa-81e3-988f4bf03a49 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.915740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4f3bf-d452-41fa-81e3-988f4bf03a49 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.971564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ade90-43aa-4811-b06d-f2c5899a891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.972230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ade90-43aa-4811-b06d-f2c5899a891a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.972514 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ade90-43aa-4811-b06d-f2c5899a891a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.972789 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ade90-43aa-4811-b06d-f2c5899a891a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.973414 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ade90-43aa-4811-b06d-f2c5899a891a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.975368 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ade90-43aa-4811-b06d-f2c5899a891a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.992911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:13.999992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1352/2699] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:13 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:14.003768 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ad8b5-420d-42a3-90d9-9c02ce279d7c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.014073 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ad8b5-420d-42a3-90d9-9c02ce279d7c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.019364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8244a-1527-42ee-8e04-947be2cee973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.019959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8244a-1527-42ee-8e04-947be2cee973 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.020240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8244a-1527-42ee-8e04-947be2cee973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.020546 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8244a-1527-42ee-8e04-947be2cee973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.021185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8244a-1527-42ee-8e04-947be2cee973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.022824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8244a-1527-42ee-8e04-947be2cee973 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.033462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1348/2700] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:14.037377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ade90-43aa-4811-b06d-f2c5899a891a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.047347 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ade90-43aa-4811-b06d-f2c5899a891a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.051936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898fb87-afc6-432e-b54c-e5e672587f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.052525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898fb87-afc6-432e-b54c-e5e672587f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.052809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898fb87-afc6-432e-b54c-e5e672587f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.053085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898fb87-afc6-432e-b54c-e5e672587f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.053719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898fb87-afc6-432e-b54c-e5e672587f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.055354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898fb87-afc6-432e-b54c-e5e672587f8f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.065619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1353/2701] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:14.069650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8244a-1527-42ee-8e04-947be2cee973 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.080317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8244a-1527-42ee-8e04-947be2cee973 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.084953 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeacf3f-dfc0-4257-915f-05c0ce0a8be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.085596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeacf3f-dfc0-4257-915f-05c0ce0a8be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.085914 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeacf3f-dfc0-4257-915f-05c0ce0a8be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.086196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeacf3f-dfc0-4257-915f-05c0ce0a8be2 admin admin] PATH_INFO: `/v3/projects/a3b1acb099ae450189a08ae2077e65f5/users/7c765ea7a7354c2ebdfdb21decf8a28d/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.100368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeacf3f-dfc0-4257-915f-05c0ce0a8be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b1acb099ae450189a08ae2077e65f5, user_id=7c765ea7a7354c2ebdfdb21decf8a28d, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.103085 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeacf3f-dfc0-4257-915f-05c0ce0a8be2 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.115617 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1349/2702] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:14 2022] PUT /identity/v3/projects/a3b1acb099ae450189a08ae2077e65f5/users/7c765ea7a7354c2ebdfdb21decf8a28d/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:14.127900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164a23-b25b-4762-a24b-e8ca0bf717ba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.128402 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164a23-b25b-4762-a24b-e8ca0bf717ba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.128743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6164a23-b25b-4762-a24b-e8ca0bf717ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.159036 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f6164a23-b25b-4762-a24b-e8ca0bf717ba None None] MFA Rules not processed for user `7c765ea7a7354c2ebdfdb21decf8a28d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:14.160169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f6164a23-b25b-4762-a24b-e8ca0bf717ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:14.222400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1354/2703] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:14.226867 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeacf3f-dfc0-4257-915f-05c0ce0a8be2 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.241380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:14.293334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeacf3f-dfc0-4257-915f-05c0ce0a8be2 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.298913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9b02-22b0-4364-8759-2280c8ad355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.299517 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9b02-22b0-4364-8759-2280c8ad355c admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.299787 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9b02-22b0-4364-8759-2280c8ad355c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.300056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae9b02-22b0-4364-8759-2280c8ad355c admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.300711 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae9b02-22b0-4364-8759-2280c8ad355c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.302634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae9b02-22b0-4364-8759-2280c8ad355c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.329668 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1350/2704] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:14 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:14.335451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164a23-b25b-4762-a24b-e8ca0bf717ba None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.347496 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6164a23-b25b-4762-a24b-e8ca0bf717ba None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.403300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9042bf-fa58-49fa-b150-d419dc7ba42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.403951 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9042bf-fa58-49fa-b150-d419dc7ba42a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.404165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9042bf-fa58-49fa-b150-d419dc7ba42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.404434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9042bf-fa58-49fa-b150-d419dc7ba42a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.405062 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9042bf-fa58-49fa-b150-d419dc7ba42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.407962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9042bf-fa58-49fa-b150-d419dc7ba42a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.428457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1355/2705] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:14 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:14.432200 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9b02-22b0-4364-8759-2280c8ad355c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.442545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae9b02-22b0-4364-8759-2280c8ad355c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.447067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4161d0-8df0-455e-ac6c-61d642d6d6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.447662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4161d0-8df0-455e-ac6c-61d642d6d6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.447950 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4161d0-8df0-455e-ac6c-61d642d6d6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.448223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4161d0-8df0-455e-ac6c-61d642d6d6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.448872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4161d0-8df0-455e-ac6c-61d642d6d6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.450515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4161d0-8df0-455e-ac6c-61d642d6d6d5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.461486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1351/2706] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:14.465536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9042bf-fa58-49fa-b150-d419dc7ba42a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.476501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9042bf-fa58-49fa-b150-d419dc7ba42a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.481023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e58f-6593-40cc-8d48-0e918f7cdd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.481661 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e58f-6593-40cc-8d48-0e918f7cdd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.481965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e58f-6593-40cc-8d48-0e918f7cdd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.482236 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5e58f-6593-40cc-8d48-0e918f7cdd42 admin admin] PATH_INFO: `/v3/projects/557452c604404734a841379df14b0f27/users/b4dcab6be362453e82edcaef1cedfbc0/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.497152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5e58f-6593-40cc-8d48-0e918f7cdd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557452c604404734a841379df14b0f27, user_id=b4dcab6be362453e82edcaef1cedfbc0, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.500356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5e58f-6593-40cc-8d48-0e918f7cdd42 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.513370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1356/2707] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:14 2022] PUT /identity/v3/projects/557452c604404734a841379df14b0f27/users/b4dcab6be362453e82edcaef1cedfbc0/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:14.517981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4161d0-8df0-455e-ac6c-61d642d6d6d5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.528210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4161d0-8df0-455e-ac6c-61d642d6d6d5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.585181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09dda3-8a86-4f45-aa7d-fd1ed801b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.585779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09dda3-8a86-4f45-aa7d-fd1ed801b7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.586088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09dda3-8a86-4f45-aa7d-fd1ed801b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.586362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09dda3-8a86-4f45-aa7d-fd1ed801b7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.586995 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09dda3-8a86-4f45-aa7d-fd1ed801b7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.588597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09dda3-8a86-4f45-aa7d-fd1ed801b7b3 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.599674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1352/2708] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:14.603810 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e58f-6593-40cc-8d48-0e918f7cdd42 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.614467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5e58f-6593-40cc-8d48-0e918f7cdd42 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.619287 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.619920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.620200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.620467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] PATH_INFO: `/v3/projects/557452c604404734a841379df14b0f27/users/b4dcab6be362453e82edcaef1cedfbc0/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.622383 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557452c604404734a841379df14b0f27, user_id=b4dcab6be362453e82edcaef1cedfbc0, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.626440 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.636399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1357/2709] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:14 2022] PUT /identity/v3/projects/557452c604404734a841379df14b0f27/users/b4dcab6be362453e82edcaef1cedfbc0/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:14.647681 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613177f-18f1-46c7-aa48-12d5141480a5 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.647971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613177f-18f1-46c7-aa48-12d5141480a5 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.648244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613177f-18f1-46c7-aa48-12d5141480a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.678075 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3613177f-18f1-46c7-aa48-12d5141480a5 None None] MFA Rules not processed for user `b4dcab6be362453e82edcaef1cedfbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:14.679339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3613177f-18f1-46c7-aa48-12d5141480a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:14.748522 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1353/2710] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:14.760207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.761888 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:14.793781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:14.820288 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03aaba-48d9-49d0-875e-1c292bd46368 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.823865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8826-5cf1-4624-99fd-5a8d4d0571ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.824455 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8826-5cf1-4624-99fd-5a8d4d0571ee service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.824735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8826-5cf1-4624-99fd-5a8d4d0571ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.825006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8826-5cf1-4624-99fd-5a8d4d0571ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.880298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee8826-5cf1-4624-99fd-5a8d4d0571ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.881733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee8826-5cf1-4624-99fd-5a8d4d0571ee service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.891463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1358/2711] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:16.389265 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613177f-18f1-46c7-aa48-12d5141480a5 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:16.391252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3613177f-18f1-46c7-aa48-12d5141480a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:16.403223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613177f-18f1-46c7-aa48-12d5141480a5 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:16.407360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5064f-a753-4b61-9560-6ac4f65b418f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:16.407956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5064f-a753-4b61-9560-6ac4f65b418f service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:16.408234 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5064f-a753-4b61-9560-6ac4f65b418f service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:16.408509 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5064f-a753-4b61-9560-6ac4f65b418f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:16.413529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:16.466605 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5064f-a753-4b61-9560-6ac4f65b418f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:16.468046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5064f-a753-4b61-9560-6ac4f65b418f service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:16.477727 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1354/2712] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:17.167711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8826-5cf1-4624-99fd-5a8d4d0571ee service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:17.176958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8826-5cf1-4624-99fd-5a8d4d0571ee service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:17.180545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdb6fa-b5fd-4c77-8877-5281ddca7f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:17.181147 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb6fa-b5fd-4c77-8877-5281ddca7f6c service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:17.181427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb6fa-b5fd-4c77-8877-5281ddca7f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:17.181697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb6fa-b5fd-4c77-8877-5281ddca7f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:17.191599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdb6fa-b5fd-4c77-8877-5281ddca7f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:17.193025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdb6fa-b5fd-4c77-8877-5281ddca7f6c service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:17.202434 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1359/2713] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:21.076583 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5064f-a753-4b61-9560-6ac4f65b418f service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:21.141804 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5064f-a753-4b61-9560-6ac4f65b418f service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:21.146767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:21.147607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:21.148156 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:21.148600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] PATH_INFO: `/v3/users/ea73982e46ff47a689d1abe1f4bbd4d8` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:21.149920 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea73982e46ff47a689d1abe1f4bbd4d8)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:21.151893 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:21.197719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea73982e46ff47a689d1abe1f4bbd4d8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.198394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea73982e46ff47a689d1abe1f4bbd4d8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.211304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea73982e46ff47a689d1abe1f4bbd4d8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.218584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea73982e46ff47a689d1abe1f4bbd4d8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.219205 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea73982e46ff47a689d1abe1f4bbd4d8'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.232304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1355/2714] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:21 2022] DELETE /identity/v3/users/ea73982e46ff47a689d1abe1f4bbd4d8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:21.237546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b52f9-a54a-499a-9097-7b87b092cd84 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:21.238118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b52f9-a54a-499a-9097-7b87b092cd84 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:21.238291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b52f9-a54a-499a-9097-7b87b092cd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:21.256732 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ef2b52f9-a54a-499a-9097-7b87b092cd84 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:21.257981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef2b52f9-a54a-499a-9097-7b87b092cd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:21.315298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1360/2715] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:21.324957 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:21.326401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:21.357359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:21.387005 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d0b7-2342-426b-9c79-9fc1d67ab8e4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:21.390714 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9105-f160-4da7-a105-7509d8349513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:21.391319 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9105-f160-4da7-a105-7509d8349513 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:21.391603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9105-f160-4da7-a105-7509d8349513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:21.391946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9105-f160-4da7-a105-7509d8349513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:21.400935 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a9105-f160-4da7-a105-7509d8349513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:21.402448 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a9105-f160-4da7-a105-7509d8349513 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:21.412927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1356/2716] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:21.686446 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b52f9-a54a-499a-9097-7b87b092cd84 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:21.687924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef2b52f9-a54a-499a-9097-7b87b092cd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:21.701713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b52f9-a54a-499a-9097-7b87b092cd84 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:21.708352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:21.709010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:21.709292 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:21.709569 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] PATH_INFO: `/v3/projects/48abc10791c14e8786d21dcf30ab4a11` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:21.710753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48abc10791c14e8786d21dcf30ab4a11)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:21.712725 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:21.762929 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48abc10791c14e8786d21dcf30ab4a11', 'request_id': 'req-4c3f14c5-581f-4157-a262-bf228bfdd003'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.770356 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48abc10791c14e8786d21dcf30ab4a11', 'request_id': 'req-4c3f14c5-581f-4157-a262-bf228bfdd003'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.776003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48abc10791c14e8786d21dcf30ab4a11', 'request_id': 'req-4c3f14c5-581f-4157-a262-bf228bfdd003'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.777114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:21.789672 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] The token cache is being invalidate because project 48abc10791c14e8786d21dcf30ab4a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:21.789985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.790619 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.792159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1361/2717] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:21 2022] DELETE /identity/v3/projects/48abc10791c14e8786d21dcf30ab4a11 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:21.796154 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9105-f160-4da7-a105-7509d8349513 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:21.807025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9105-f160-4da7-a105-7509d8349513 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:21.865007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:21.865643 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:21.865968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:21.866249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] PATH_INFO: `/v3/users/7c765ea7a7354c2ebdfdb21decf8a28d` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:21.867685 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c765ea7a7354c2ebdfdb21decf8a28d)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:21.869751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:21.923678 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c765ea7a7354c2ebdfdb21decf8a28d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.924963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c765ea7a7354c2ebdfdb21decf8a28d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.938615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c765ea7a7354c2ebdfdb21decf8a28d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.948088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c765ea7a7354c2ebdfdb21decf8a28d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.948692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c765ea7a7354c2ebdfdb21decf8a28d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:21.961816 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1357/2718] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:21 2022] DELETE /identity/v3/users/7c765ea7a7354c2ebdfdb21decf8a28d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:22.245692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:22.248491 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:22.264179 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f14c5-581f-4157-a262-bf228bfdd003 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:22.325792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:22.326469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:22.326750 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:22.327025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] PATH_INFO: `/v3/projects/a3b1acb099ae450189a08ae2077e65f5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:22.328143 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b1acb099ae450189a08ae2077e65f5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:22.330823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:22.378291 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b1acb099ae450189a08ae2077e65f5', 'request_id': 'req-f118b3ed-07af-48ae-a53f-6bda1ba96329'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.385790 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b1acb099ae450189a08ae2077e65f5', 'request_id': 'req-f118b3ed-07af-48ae-a53f-6bda1ba96329'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.392354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b1acb099ae450189a08ae2077e65f5', 'request_id': 'req-f118b3ed-07af-48ae-a53f-6bda1ba96329'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.404162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] The token cache is being invalidate because project a3b1acb099ae450189a08ae2077e65f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:22.404546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.405253 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.406786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1362/2719] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:22 2022] DELETE /identity/v3/projects/a3b1acb099ae450189a08ae2077e65f5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:22.411483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:22.412942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:22.425651 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d91a60-0c0e-4dbd-a8cb-49213dfffcb4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:22.472809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:22.486232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:22.486872 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:22.487153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:22.487429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] PATH_INFO: `/v3/users/b4dcab6be362453e82edcaef1cedfbc0` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:22.488592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dcab6be362453e82edcaef1cedfbc0)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:22.490691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:22.539593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dcab6be362453e82edcaef1cedfbc0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.540394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dcab6be362453e82edcaef1cedfbc0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.552811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dcab6be362453e82edcaef1cedfbc0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.562231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dcab6be362453e82edcaef1cedfbc0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.562851 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-b3c1d5db-428e-4f5c-82c8-893c0eb90469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dcab6be362453e82edcaef1cedfbc0'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:22.575344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1358/2720] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:22 2022] DELETE /identity/v3/users/b4dcab6be362453e82edcaef1cedfbc0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:22.991207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:22.992901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:23.006029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118b3ed-07af-48ae-a53f-6bda1ba96329 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:23.070111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:23.070746 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.071025 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.073530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] PATH_INFO: `/v3/projects/557452c604404734a841379df14b0f27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.074795 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=557452c604404734a841379df14b0f27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:23.076992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:23.116419 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:23.140357 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557452c604404734a841379df14b0f27', 'request_id': 'req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:23.148707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557452c604404734a841379df14b0f27', 'request_id': 'req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:23.154449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557452c604404734a841379df14b0f27', 'request_id': 'req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:23.166195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] The token cache is being invalidate because project 557452c604404734a841379df14b0f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:23.166478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:23.167118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0d6566c-4771-4f8c-b6ca-b0720b80e3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:23.168840 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1363/2721] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:22 2022] DELETE /identity/v3/projects/557452c604404734a841379df14b0f27 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:23.174856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d213-8299-480a-95e2-378896032050 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.175170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d213-8299-480a-95e2-378896032050 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.175452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d213-8299-480a-95e2-378896032050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.198776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-eaf0d213-8299-480a-95e2-378896032050 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:23.206289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-eaf0d213-8299-480a-95e2-378896032050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:23.301892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1359/2722] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:23.375931 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2a47-7435-451c-ad1a-447d21a90bbd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.377163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2a47-7435-451c-ad1a-447d21a90bbd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.377163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2a47-7435-451c-ad1a-447d21a90bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.402117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d28a2a47-7435-451c-ad1a-447d21a90bbd None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:23.403396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d28a2a47-7435-451c-ad1a-447d21a90bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:23.412107 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1364/2723] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:23.416648 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d213-8299-480a-95e2-378896032050 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:23.430454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d213-8299-480a-95e2-378896032050 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:23.436039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:23.436672 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.437199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.437444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.438140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:23.438450 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:23.441095 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:23.454545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1360/2724] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:23.459437 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a2a47-7435-451c-ad1a-447d21a90bbd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:23.473829 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a2a47-7435-451c-ad1a-447d21a90bbd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:23.479135 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667d545-2ff3-43f6-9d44-93fc1d0dc2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:23.480283 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667d545-2ff3-43f6-9d44-93fc1d0dc2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.480734 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667d545-2ff3-43f6-9d44-93fc1d0dc2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.481171 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667d545-2ff3-43f6-9d44-93fc1d0dc2b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.482215 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667d545-2ff3-43f6-9d44-93fc1d0dc2b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:23.484448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667d545-2ff3-43f6-9d44-93fc1d0dc2b7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:23.519213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:23.519678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1365/2725] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:23 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:23.531351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0664-6a6b-4f9c-90ab-902acf36c98c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:23.586958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:23.596397 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf5328-c9db-448a-b653-cf42d7b0f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:23.596975 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf5328-c9db-448a-b653-cf42d7b0f9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.597259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf5328-c9db-448a-b653-cf42d7b0f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.597562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf5328-c9db-448a-b653-cf42d7b0f9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.598549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf5328-c9db-448a-b653-cf42d7b0f9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:23.601027 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf5328-c9db-448a-b653-cf42d7b0f9d5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:23.626685 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1361/2726] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:23 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:23.630702 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667d545-2ff3-43f6-9d44-93fc1d0dc2b7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:23.644665 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667d545-2ff3-43f6-9d44-93fc1d0dc2b7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:23.650550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f15b8f-799a-4dcc-bce4-8a3bbd6123f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:23.651153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f15b8f-799a-4dcc-bce4-8a3bbd6123f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.651428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f15b8f-799a-4dcc-bce4-8a3bbd6123f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.651712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f15b8f-799a-4dcc-bce4-8a3bbd6123f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.652333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f15b8f-799a-4dcc-bce4-8a3bbd6123f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:23.653979 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f15b8f-799a-4dcc-bce4-8a3bbd6123f1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:23.665681 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1366/2727] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:23.669833 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf5328-c9db-448a-b653-cf42d7b0f9d5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:23.680671 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf5328-c9db-448a-b653-cf42d7b0f9d5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:23.685466 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18352b7-f767-4ac3-a7b0-596b57b39a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:23.686371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18352b7-f767-4ac3-a7b0-596b57b39a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.686371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18352b7-f767-4ac3-a7b0-596b57b39a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.687003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18352b7-f767-4ac3-a7b0-596b57b39a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.687896 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18352b7-f767-4ac3-a7b0-596b57b39a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:23.689937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18352b7-f767-4ac3-a7b0-596b57b39a24 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:23.701007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1362/2728] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:23.705473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f15b8f-799a-4dcc-bce4-8a3bbd6123f1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:23.715823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f15b8f-799a-4dcc-bce4-8a3bbd6123f1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:23.721269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:23.721991 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.722285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.722582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] PATH_INFO: `/v3/projects/06143008b02444218a0ba066f362c8c2/users/9b2bddd14b3540acb353899cfcb9aa6d/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.738427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06143008b02444218a0ba066f362c8c2, user_id=9b2bddd14b3540acb353899cfcb9aa6d, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:23.741189 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:23.755099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1367/2729] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:23 2022] PUT /identity/v3/projects/06143008b02444218a0ba066f362c8c2/users/9b2bddd14b3540acb353899cfcb9aa6d/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:23.765141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57990-41c0-45e3-a17e-07a380e320d0 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.765429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57990-41c0-45e3-a17e-07a380e320d0 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.765698 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57990-41c0-45e3-a17e-07a380e320d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.796597 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-1cc57990-41c0-45e3-a17e-07a380e320d0 None None] MFA Rules not processed for user `9b2bddd14b3540acb353899cfcb9aa6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:23.797809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-1cc57990-41c0-45e3-a17e-07a380e320d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:23.872784 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1363/2730] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:23.886632 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:23.889793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:23.962857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff399a3-a0e1-4838-968e-3b8802880748 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:23.968371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886facdf-ecff-43a0-8a1e-2c44cc09563c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:23.968371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886facdf-ecff-43a0-8a1e-2c44cc09563c service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:23.968606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886facdf-ecff-43a0-8a1e-2c44cc09563c service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:23.968785 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886facdf-ecff-43a0-8a1e-2c44cc09563c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:23.980097 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886facdf-ecff-43a0-8a1e-2c44cc09563c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:23.981546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886facdf-ecff-43a0-8a1e-2c44cc09563c service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:23.991426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1368/2731] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:26.604819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc57990-41c0-45e3-a17e-07a380e320d0 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:26.672607 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc57990-41c0-45e3-a17e-07a380e320d0 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:26.677119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:26.677741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:26.678048 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:26.678321 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] PATH_INFO: `/v3/users/9b2bddd14b3540acb353899cfcb9aa6d` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:26.679422 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2bddd14b3540acb353899cfcb9aa6d)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:26.681339 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:26.727865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2bddd14b3540acb353899cfcb9aa6d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.728440 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2bddd14b3540acb353899cfcb9aa6d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.740236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2bddd14b3540acb353899cfcb9aa6d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.742317 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:26.748287 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2bddd14b3540acb353899cfcb9aa6d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.749055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2bddd14b3540acb353899cfcb9aa6d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.763216 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1364/2732] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:26 2022] DELETE /identity/v3/users/9b2bddd14b3540acb353899cfcb9aa6d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:26.768530 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aba7-e293-42f7-9213-11e51c724f15 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:26.769019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aba7-e293-42f7-9213-11e51c724f15 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:26.769128 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46aba7-e293-42f7-9213-11e51c724f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:26.787960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9c46aba7-e293-42f7-9213-11e51c724f15 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:26.789174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c46aba7-e293-42f7-9213-11e51c724f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:26.835101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:26.848636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1369/2733] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:26.858459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:26.859848 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:26.921211 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebbd62-71e9-405d-bb84-b3d76fa0fcc7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:26.925539 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec38123-b180-4297-add2-ef2a4d75726b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:26.926185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38123-b180-4297-add2-ef2a4d75726b service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:26.926471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38123-b180-4297-add2-ef2a4d75726b service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:26.926745 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec38123-b180-4297-add2-ef2a4d75726b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:26.935581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec38123-b180-4297-add2-ef2a4d75726b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:26.937020 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec38123-b180-4297-add2-ef2a4d75726b service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:26.947118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1365/2734] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:27.215867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46aba7-e293-42f7-9213-11e51c724f15 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.217545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c46aba7-e293-42f7-9213-11e51c724f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:27.232548 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46aba7-e293-42f7-9213-11e51c724f15 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.238393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.239220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.239561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.240079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] PATH_INFO: `/v3/projects/06143008b02444218a0ba066f362c8c2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.241295 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06143008b02444218a0ba066f362c8c2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.243845 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.291326 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06143008b02444218a0ba066f362c8c2', 'request_id': 'req-7381cf10-f69e-4a41-bff4-f4177a50fee0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.298775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06143008b02444218a0ba066f362c8c2', 'request_id': 'req-7381cf10-f69e-4a41-bff4-f4177a50fee0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.304495 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06143008b02444218a0ba066f362c8c2', 'request_id': 'req-7381cf10-f69e-4a41-bff4-f4177a50fee0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.316274 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] The token cache is being invalidate because project 06143008b02444218a0ba066f362c8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:27.316690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.317331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7381cf10-f69e-4a41-bff4-f4177a50fee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.318849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1370/2735] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:27 2022] DELETE /identity/v3/projects/06143008b02444218a0ba066f362c8c2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:27.323760 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc90c-ccca-4328-a233-9e6c908f8dc2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.324046 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc90c-ccca-4328-a233-9e6c908f8dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.324325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc90c-ccca-4328-a233-9e6c908f8dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.344387 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-685cc90c-ccca-4328-a233-9e6c908f8dc2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:27.345609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-685cc90c-ccca-4328-a233-9e6c908f8dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:27.404854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1366/2736] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:27.413033 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3f68-42a8-4358-9e20-3f9715066f30 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.413324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3f68-42a8-4358-9e20-3f9715066f30 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.413605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a3f68-42a8-4358-9e20-3f9715066f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.433676 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2e4a3f68-42a8-4358-9e20-3f9715066f30 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:27.434918 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e4a3f68-42a8-4358-9e20-3f9715066f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:27.443511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1371/2737] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:27.447625 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cc90c-ccca-4328-a233-9e6c908f8dc2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.458129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cc90c-ccca-4328-a233-9e6c908f8dc2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.462719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.463314 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.463593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.463865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.464503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:27.464806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.466437 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.478658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1367/2738] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:27.482713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3f68-42a8-4358-9e20-3f9715066f30 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.492874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a3f68-42a8-4358-9e20-3f9715066f30 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.497387 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c9ccd-f23d-4a4c-aef9-b1b85b2fd688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.498019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c9ccd-f23d-4a4c-aef9-b1b85b2fd688 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.498302 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c9ccd-f23d-4a4c-aef9-b1b85b2fd688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.498576 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c9ccd-f23d-4a4c-aef9-b1b85b2fd688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.499194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c9ccd-f23d-4a4c-aef9-b1b85b2fd688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.501174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c9ccd-f23d-4a4c-aef9-b1b85b2fd688 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.527905 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1372/2739] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:27 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:27.531977 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.542814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248fbfd-2a59-4406-94bd-0a92aef13962 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.600030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31bc9-cc2e-446a-a1ba-c9616275c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.600633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31bc9-cc2e-446a-a1ba-c9616275c908 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.600913 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31bc9-cc2e-446a-a1ba-c9616275c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.601186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31bc9-cc2e-446a-a1ba-c9616275c908 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.601813 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a31bc9-cc2e-446a-a1ba-c9616275c908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.603773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a31bc9-cc2e-446a-a1ba-c9616275c908 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.627611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1368/2740] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:27 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:27.631878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c9ccd-f23d-4a4c-aef9-b1b85b2fd688 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.642545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c9ccd-f23d-4a4c-aef9-b1b85b2fd688 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.647740 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81879d5-1e16-4df6-8c49-dc63c37a1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.648454 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81879d5-1e16-4df6-8c49-dc63c37a1750 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.648831 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81879d5-1e16-4df6-8c49-dc63c37a1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.649201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81879d5-1e16-4df6-8c49-dc63c37a1750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.649981 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81879d5-1e16-4df6-8c49-dc63c37a1750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.651714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81879d5-1e16-4df6-8c49-dc63c37a1750 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.666518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1373/2741] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:27.667725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31bc9-cc2e-446a-a1ba-c9616275c908 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.673778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:27.682040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31bc9-cc2e-446a-a1ba-c9616275c908 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.687304 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c9071-37f2-4e4f-9bca-ae7bc512420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.687998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9071-37f2-4e4f-9bca-ae7bc512420c admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.688355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9071-37f2-4e4f-9bca-ae7bc512420c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.688741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c9071-37f2-4e4f-9bca-ae7bc512420c admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.690042 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c9071-37f2-4e4f-9bca-ae7bc512420c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.691765 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c9071-37f2-4e4f-9bca-ae7bc512420c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.703018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1369/2742] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:27.707561 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81879d5-1e16-4df6-8c49-dc63c37a1750 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.717712 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81879d5-1e16-4df6-8c49-dc63c37a1750 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.722983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.723638 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.723923 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.724205 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] PATH_INFO: `/v3/projects/849189f34639414ebb5f55d06fcd6bdb/users/bd254f3c79b246078b09b2a2d40f9c6e/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.744370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849189f34639414ebb5f55d06fcd6bdb, user_id=bd254f3c79b246078b09b2a2d40f9c6e, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.747114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.762172 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1374/2743] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:27 2022] PUT /identity/v3/projects/849189f34639414ebb5f55d06fcd6bdb/users/bd254f3c79b246078b09b2a2d40f9c6e/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:27.773680 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdc5a4-cc62-42bc-9cbd-10af225d1bae None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.774015 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdc5a4-cc62-42bc-9cbd-10af225d1bae None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.774290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdc5a4-cc62-42bc-9cbd-10af225d1bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.802581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-0ccdc5a4-cc62-42bc-9cbd-10af225d1bae None None] MFA Rules not processed for user `bd254f3c79b246078b09b2a2d40f9c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:27.803780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-0ccdc5a4-cc62-42bc-9cbd-10af225d1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:27.873562 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1370/2744] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:27.884713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.886552 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:27.942704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1f32-69e2-4834-9d04-47fd114deab5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.946739 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc770-a9ee-49c3-8568-09b057306635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.947340 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc770-a9ee-49c3-8568-09b057306635 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.947623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc770-a9ee-49c3-8568-09b057306635 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.947898 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc770-a9ee-49c3-8568-09b057306635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.957064 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbc770-a9ee-49c3-8568-09b057306635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.958541 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbc770-a9ee-49c3-8568-09b057306635 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.967430 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1375/2745] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:31.897175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae746-249f-4473-9ccb-5923c6dde861 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:31.897694 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae746-249f-4473-9ccb-5923c6dde861 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:31.897819 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae746-249f-4473-9ccb-5923c6dde861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.039459 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-cd5ae746-249f-4473-9ccb-5923c6dde861 None None] MFA Rules not processed for user `065f1d6441424ce48ef37c1593ca8d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:32.040705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-cd5ae746-249f-4473-9ccb-5923c6dde861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:32.096357 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1371/2746] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:37.963423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:38.067936 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc770-a9ee-49c3-8568-09b057306635 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:38.133620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc770-a9ee-49c3-8568-09b057306635 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:38.138261 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:38.138893 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:38.139174 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:38.139448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] PATH_INFO: `/v3/users/bd254f3c79b246078b09b2a2d40f9c6e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:38.140563 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd254f3c79b246078b09b2a2d40f9c6e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:38.142819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:38.190323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd254f3c79b246078b09b2a2d40f9c6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.190980 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd254f3c79b246078b09b2a2d40f9c6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.202607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd254f3c79b246078b09b2a2d40f9c6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.209904 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd254f3c79b246078b09b2a2d40f9c6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.210579 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd254f3c79b246078b09b2a2d40f9c6e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.222594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1376/2747] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:38 2022] DELETE /identity/v3/users/bd254f3c79b246078b09b2a2d40f9c6e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:38.226998 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e70487-8028-4729-924d-19244873376e None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:38.227500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e70487-8028-4729-924d-19244873376e None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:38.227603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e70487-8028-4729-924d-19244873376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:38.246580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-48e70487-8028-4729-924d-19244873376e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:38.247801 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-48e70487-8028-4729-924d-19244873376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:38.309056 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1372/2748] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:38.318982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:38.320323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:38.379964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ca69d-b718-4a09-a9f8-e5e6f4012152 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:38.383596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c8ab4-5bfa-4726-8f16-31327878da86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:38.384249 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8ab4-5bfa-4726-8f16-31327878da86 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:38.384522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8ab4-5bfa-4726-8f16-31327878da86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:38.384787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8ab4-5bfa-4726-8f16-31327878da86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:38.393683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c8ab4-5bfa-4726-8f16-31327878da86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:38.395250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c8ab4-5bfa-4726-8f16-31327878da86 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:38.404464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1377/2749] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:38.670260 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e70487-8028-4729-924d-19244873376e None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:38.671699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-48e70487-8028-4729-924d-19244873376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:38.683740 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e70487-8028-4729-924d-19244873376e None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:38.688351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:38.688987 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:38.689271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:38.690254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] PATH_INFO: `/v3/projects/849189f34639414ebb5f55d06fcd6bdb` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:38.691545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=849189f34639414ebb5f55d06fcd6bdb)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:38.693378 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:38.716811 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:38.740996 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849189f34639414ebb5f55d06fcd6bdb', 'request_id': 'req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.746870 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849189f34639414ebb5f55d06fcd6bdb', 'request_id': 'req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.755181 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849189f34639414ebb5f55d06fcd6bdb', 'request_id': 'req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.766971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] The token cache is being invalidate because project 849189f34639414ebb5f55d06fcd6bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:38.767259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.768490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-0a6dd6a3-d13f-4593-a1f1-cb8a005e5bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:38.769999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1373/2750] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:38 2022] DELETE /identity/v3/projects/849189f34639414ebb5f55d06fcd6bdb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:38.775522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bf36-7000-49ce-8069-9092737d493b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:38.775820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bf36-7000-49ce-8069-9092737d493b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:38.776101 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bf36-7000-49ce-8069-9092737d493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:38.795963 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-df95bf36-7000-49ce-8069-9092737d493b None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:38.797200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df95bf36-7000-49ce-8069-9092737d493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:38.816404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:38.867608 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1378/2751] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:38.875123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801e4e-26b9-4054-9a3f-b36d4bdf34f2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:38.875482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801e4e-26b9-4054-9a3f-b36d4bdf34f2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:38.875824 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801e4e-26b9-4054-9a3f-b36d4bdf34f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:38.895475 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b5801e4e-26b9-4054-9a3f-b36d4bdf34f2 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:38.896676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b5801e4e-26b9-4054-9a3f-b36d4bdf34f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:38.904603 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1374/2752] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:38.909007 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95bf36-7000-49ce-8069-9092737d493b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:38.919476 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95bf36-7000-49ce-8069-9092737d493b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:38.924874 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:38.925529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:38.925815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:38.926166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:38.926761 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:38.927063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:38.930093 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:38.945878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1379/2753] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:38.947338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5801e4e-26b9-4054-9a3f-b36d4bdf34f2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:38.961777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5801e4e-26b9-4054-9a3f-b36d4bdf34f2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:38.966634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08735fb3-dcae-433a-aa01-b72884fb37e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:38.967241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08735fb3-dcae-433a-aa01-b72884fb37e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:38.967515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08735fb3-dcae-433a-aa01-b72884fb37e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:38.967781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08735fb3-dcae-433a-aa01-b72884fb37e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:38.968411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08735fb3-dcae-433a-aa01-b72884fb37e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:38.970341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08735fb3-dcae-433a-aa01-b72884fb37e5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:39.003264 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1375/2754] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:38 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:39.006658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:39.016943 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37350cf-6e98-457b-b08b-2e890fd6a902 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:39.076021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a1e7d-d76a-414a-b85b-8da29edae279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:39.076653 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1e7d-d76a-414a-b85b-8da29edae279 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:39.076938 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1e7d-d76a-414a-b85b-8da29edae279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:39.077269 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1e7d-d76a-414a-b85b-8da29edae279 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:39.077935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a1e7d-d76a-414a-b85b-8da29edae279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:39.079900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a1e7d-d76a-414a-b85b-8da29edae279 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:39.110372 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1380/2755] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:39 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:39.112121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08735fb3-dcae-433a-aa01-b72884fb37e5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:39.123275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08735fb3-dcae-433a-aa01-b72884fb37e5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:39.128741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5542a8-7770-43d9-befe-0f1723cdabe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:39.129384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5542a8-7770-43d9-befe-0f1723cdabe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:39.129664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5542a8-7770-43d9-befe-0f1723cdabe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:39.129974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5542a8-7770-43d9-befe-0f1723cdabe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:39.130751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5542a8-7770-43d9-befe-0f1723cdabe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:39.132346 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5542a8-7770-43d9-befe-0f1723cdabe5 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:39.147632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1376/2756] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:39.149126 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a1e7d-d76a-414a-b85b-8da29edae279 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:39.161400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a1e7d-d76a-414a-b85b-8da29edae279 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:39.168416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf15f77-8f82-4171-8a2e-2f2d1e4a9c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:39.169041 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15f77-8f82-4171-8a2e-2f2d1e4a9c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:39.169325 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15f77-8f82-4171-8a2e-2f2d1e4a9c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:39.169598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15f77-8f82-4171-8a2e-2f2d1e4a9c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:39.170316 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf15f77-8f82-4171-8a2e-2f2d1e4a9c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:39.171908 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf15f77-8f82-4171-8a2e-2f2d1e4a9c6e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:39.183618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1381/2757] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:39.188418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5542a8-7770-43d9-befe-0f1723cdabe5 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:39.199368 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5542a8-7770-43d9-befe-0f1723cdabe5 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:39.204279 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:39.204958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:39.205241 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:39.205515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] PATH_INFO: `/v3/projects/cd989272e12649d591714144c7147004/users/96b8db29a9324d5fac0569ceed7e1c97/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:39.221152 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd989272e12649d591714144c7147004, user_id=96b8db29a9324d5fac0569ceed7e1c97, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:39.225354 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:39.239250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1377/2758] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:39 2022] PUT /identity/v3/projects/cd989272e12649d591714144c7147004/users/96b8db29a9324d5fac0569ceed7e1c97/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:39.244509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44c56-25ee-4f13-af6d-137842d8212f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:39.244798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44c56-25ee-4f13-af6d-137842d8212f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:39.245070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44c56-25ee-4f13-af6d-137842d8212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:39.263714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c0f44c56-25ee-4f13-af6d-137842d8212f None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:39.264858 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0f44c56-25ee-4f13-af6d-137842d8212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:39.327102 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1382/2759] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:39.336956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:39.338739 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:39.398670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5116958-9f0a-4c5a-a327-f509bf3badca admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:39.402616 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:39.403213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:39.403489 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:39.403758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:39.415373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:39.416806 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:39.427096 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1378/2760] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:40.075057 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566ddd7-7c5b-4c78-8c29-ffe22315fe10 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:40.075623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566ddd7-7c5b-4c78-8c29-ffe22315fe10 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:40.075623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566ddd7-7c5b-4c78-8c29-ffe22315fe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:40.105670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a566ddd7-7c5b-4c78-8c29-ffe22315fe10 None None] MFA Rules not processed for user `96b8db29a9324d5fac0569ceed7e1c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:40.107213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a566ddd7-7c5b-4c78-8c29-ffe22315fe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:40.135021 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:40.191722 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1383/2761] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:40.202573 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:40.204084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:40.258369 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:40.262928 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1725c45-c215-4947-a0fb-41fd26c5ce04 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:40.268486 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:40.269640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:40.270291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:40.270612 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:40.279624 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:40.281074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:40.289821 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1379/2762] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:41.652195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0564-0203-49a3-b21f-264689c6e479 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:41.652699 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0564-0203-49a3-b21f-264689c6e479 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:41.652820 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0564-0203-49a3-b21f-264689c6e479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:41.672003 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-06ea0564-0203-49a3-b21f-264689c6e479 None None] MFA Rules not processed for user `96b8db29a9324d5fac0569ceed7e1c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:41.673196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06ea0564-0203-49a3-b21f-264689c6e479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:41.681250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1384/2763] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:50.286004 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:51.666786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=22 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:06.215008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:06.216411 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:06.364852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd62cd4-38b1-434a-94da-c338281bf8d0 service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:06.370253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:06.370859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:06.371141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:06.371418 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:06.373163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:06.384919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:06.386630 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:06.397563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1380/2764] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:09.270076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bcbe0-f936-4595-acd0-40531d9fed24 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:09.270641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bcbe0-f936-4595-acd0-40531d9fed24 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:09.270641 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bcbe0-f936-4595-acd0-40531d9fed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:09.341442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-847bcbe0-f936-4595-acd0-40531d9fed24 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:09.342711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-847bcbe0-f936-4595-acd0-40531d9fed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:09.493593 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1385/2765] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:09.519602 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:09.522007 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:09.606308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:09.628325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7a17-eabd-4fe3-9921-f197593e3b4d service placement] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:09.637057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:09.638194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:09.638701 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:09.639142 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:09.651109 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:09.653303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:09.663650 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1381/2766] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:12.336960 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e43f-26c0-4be3-bee0-c9c5215ec05a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:12.337498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e43f-26c0-4be3-bee0-c9c5215ec05a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:12.337498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286e43f-26c0-4be3-bee0-c9c5215ec05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:12.356753 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f286e43f-26c0-4be3-bee0-c9c5215ec05a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:12.357992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f286e43f-26c0-4be3-bee0-c9c5215ec05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.365710 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1386/2767] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:12.389715 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:12.391176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.406303 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3c41-eff6-478e-98a6-b1f2e08ccd66 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:12.412256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39b9d-2adb-464e-895e-6943419ec32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:12.413549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39b9d-2adb-464e-895e-6943419ec32e service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:12.413830 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39b9d-2adb-464e-895e-6943419ec32e service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:12.414130 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39b9d-2adb-464e-895e-6943419ec32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:12.422417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39b9d-2adb-464e-895e-6943419ec32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:12.423993 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39b9d-2adb-464e-895e-6943419ec32e service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:12.433657 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1382/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:15.586582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ed072-abdb-48d3-b54d-b0b98be25bcf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:15.587478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ed072-abdb-48d3-b54d-b0b98be25bcf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:15.587478 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ed072-abdb-48d3-b54d-b0b98be25bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:15.608017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-933ed072-abdb-48d3-b54d-b0b98be25bcf None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:15.609218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-933ed072-abdb-48d3-b54d-b0b98be25bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:15.617588 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1387/2769] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:15.637769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39b9d-2adb-464e-895e-6943419ec32e service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:15.649621 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39b9d-2adb-464e-895e-6943419ec32e service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:15.655094 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9ad1-8e0d-476a-89e5-b993d02785a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:15.655685 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9ad1-8e0d-476a-89e5-b993d02785a7 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:15.655967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9ad1-8e0d-476a-89e5-b993d02785a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:15.656246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9ad1-8e0d-476a-89e5-b993d02785a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:15.664588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9ad1-8e0d-476a-89e5-b993d02785a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:15.666207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9ad1-8e0d-476a-89e5-b993d02785a7 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:15.675465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1383/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:18.680570 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053218-1709-4f85-849f-f66fb81147a4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:18.681070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053218-1709-4f85-849f-f66fb81147a4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:18.681175 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053218-1709-4f85-849f-f66fb81147a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:18.699884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-58053218-1709-4f85-849f-f66fb81147a4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:18.701080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-58053218-1709-4f85-849f-f66fb81147a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:18.708814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1388/2771] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:18.731025 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9ad1-8e0d-476a-89e5-b993d02785a7 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:18.743544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9ad1-8e0d-476a-89e5-b993d02785a7 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:18.749185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cd3f3-a8ed-4615-8fbe-f8e2dae0298a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:18.749775 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cd3f3-a8ed-4615-8fbe-f8e2dae0298a service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:18.750084 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cd3f3-a8ed-4615-8fbe-f8e2dae0298a service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:18.750355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cd3f3-a8ed-4615-8fbe-f8e2dae0298a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:18.758460 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cd3f3-a8ed-4615-8fbe-f8e2dae0298a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:18.760123 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cd3f3-a8ed-4615-8fbe-f8e2dae0298a service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:18.769281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1384/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:21.853344 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07feb1-738c-4d8d-a890-4e9240e9223e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:21.853934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07feb1-738c-4d8d-a890-4e9240e9223e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:21.853934 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07feb1-738c-4d8d-a890-4e9240e9223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:21.872870 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2f07feb1-738c-4d8d-a890-4e9240e9223e None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:21.874096 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2f07feb1-738c-4d8d-a890-4e9240e9223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:21.881860 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1389/2773] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:21.904500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cd3f3-a8ed-4615-8fbe-f8e2dae0298a service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:21.916670 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cd3f3-a8ed-4615-8fbe-f8e2dae0298a service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:21.922308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ed5a-300a-4e50-a4b8-4827729fa10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:21.922981 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ed5a-300a-4e50-a4b8-4827729fa10a service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:21.923271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ed5a-300a-4e50-a4b8-4827729fa10a service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:21.923547 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ed5a-300a-4e50-a4b8-4827729fa10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:21.932256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009ed5a-300a-4e50-a4b8-4827729fa10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:21.933961 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009ed5a-300a-4e50-a4b8-4827729fa10a service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:21.943300 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1385/2774] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:25.017407 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d964f4-b71f-4cf5-85fd-212317d773e7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:25.017978 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d964f4-b71f-4cf5-85fd-212317d773e7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:25.018077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d964f4-b71f-4cf5-85fd-212317d773e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:25.039131 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-78d964f4-b71f-4cf5-85fd-212317d773e7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:25.040342 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-78d964f4-b71f-4cf5-85fd-212317d773e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:25.048166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1390/2775] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:25.071360 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ed5a-300a-4e50-a4b8-4827729fa10a service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:25.083033 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ed5a-300a-4e50-a4b8-4827729fa10a service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:25.089002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4b7b2-1ccb-45b6-8304-a4e81e24322e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:25.089593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b7b2-1ccb-45b6-8304-a4e81e24322e service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:25.089905 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b7b2-1ccb-45b6-8304-a4e81e24322e service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:25.090180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b7b2-1ccb-45b6-8304-a4e81e24322e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:25.098579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4b7b2-1ccb-45b6-8304-a4e81e24322e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:25.100942 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4b7b2-1ccb-45b6-8304-a4e81e24322e service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:25.110641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1386/2776] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:35.033120 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=45 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:35.106451 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=39 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:39.905774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fcc2a-512f-4d92-982e-46a3a00ccaae None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:39.906324 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fcc2a-512f-4d92-982e-46a3a00ccaae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:39.906448 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fcc2a-512f-4d92-982e-46a3a00ccaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:39.927618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1b6fcc2a-512f-4d92-982e-46a3a00ccaae None None] MFA Rules not processed for user `065f1d6441424ce48ef37c1593ca8d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:39.928833 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1b6fcc2a-512f-4d92-982e-46a3a00ccaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:39.982142 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1391/2777] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:41.365423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554120b4-41a7-4bd5-bad5-8733b24281b1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:41.365930 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554120b4-41a7-4bd5-bad5-8733b24281b1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:41.366051 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554120b4-41a7-4bd5-bad5-8733b24281b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:41.386219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-554120b4-41a7-4bd5-bad5-8733b24281b1 None None] MFA Rules not processed for user `96b8db29a9324d5fac0569ceed7e1c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:41.387413 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-554120b4-41a7-4bd5-bad5-8733b24281b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:41.394349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1387/2778] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:49.975677 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=25 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:51.381327 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:56.854433 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e391-43ed-4a17-b319-cb5c91bb066a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:56.855004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e391-43ed-4a17-b319-cb5c91bb066a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:56.855133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99e391-43ed-4a17-b319-cb5c91bb066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:56.873945 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cc99e391-43ed-4a17-b319-cb5c91bb066a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:56.875151 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cc99e391-43ed-4a17-b319-cb5c91bb066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:56.883550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1392/2779] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:56.903946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554120b4-41a7-4bd5-bad5-8733b24281b1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:56.916848 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554120b4-41a7-4bd5-bad5-8733b24281b1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:56.922251 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9242-5f64-4f89-bf91-4b3e561f15ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:56.922847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9242-5f64-4f89-bf91-4b3e561f15ca service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:56.923126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9242-5f64-4f89-bf91-4b3e561f15ca service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:56.923404 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9242-5f64-4f89-bf91-4b3e561f15ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:56.931455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa9242-5f64-4f89-bf91-4b3e561f15ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:56.933034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa9242-5f64-4f89-bf91-4b3e561f15ca service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:56.942255 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1388/2780] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:00.094139 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e58b4-1e8a-46e8-b5f2-64ae9bf5cb76 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:00.094680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e58b4-1e8a-46e8-b5f2-64ae9bf5cb76 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:00.094798 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e58b4-1e8a-46e8-b5f2-64ae9bf5cb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:00.113465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0e9e58b4-1e8a-46e8-b5f2-64ae9bf5cb76 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:00.114690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0e9e58b4-1e8a-46e8-b5f2-64ae9bf5cb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:00.123213 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1393/2781] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:00.142653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9242-5f64-4f89-bf91-4b3e561f15ca service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:00.154410 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9242-5f64-4f89-bf91-4b3e561f15ca service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:00.159865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab0971-6b04-44aa-b15f-e17c5c85adc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:00.160456 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0971-6b04-44aa-b15f-e17c5c85adc9 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:00.160736 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0971-6b04-44aa-b15f-e17c5c85adc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:00.161014 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0971-6b04-44aa-b15f-e17c5c85adc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:00.170296 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab0971-6b04-44aa-b15f-e17c5c85adc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:00.171906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab0971-6b04-44aa-b15f-e17c5c85adc9 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:00.181338 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1389/2782] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:03.215392 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dba11-b9b8-459a-a816-f67c77d0db11 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:03.215911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dba11-b9b8-459a-a816-f67c77d0db11 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:03.215911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dba11-b9b8-459a-a816-f67c77d0db11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:03.234899 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-248dba11-b9b8-459a-a816-f67c77d0db11 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:03.236088 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-248dba11-b9b8-459a-a816-f67c77d0db11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:03.244885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1394/2783] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:03.270549 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab0971-6b04-44aa-b15f-e17c5c85adc9 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:03.281962 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab0971-6b04-44aa-b15f-e17c5c85adc9 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:03.287394 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b457316-bf6b-475c-bf7f-2bcd9958bcd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:03.288010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b457316-bf6b-475c-bf7f-2bcd9958bcd0 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:03.288291 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b457316-bf6b-475c-bf7f-2bcd9958bcd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:03.288565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b457316-bf6b-475c-bf7f-2bcd9958bcd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:03.296818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b457316-bf6b-475c-bf7f-2bcd9958bcd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:03.298452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b457316-bf6b-475c-bf7f-2bcd9958bcd0 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:03.308655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1390/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:06.382282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3aef-05a1-482f-ba3d-417d91d68acc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:06.382851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3aef-05a1-482f-ba3d-417d91d68acc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:06.382851 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a3aef-05a1-482f-ba3d-417d91d68acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:06.402875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1f5a3aef-05a1-482f-ba3d-417d91d68acc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:06.404078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1f5a3aef-05a1-482f-ba3d-417d91d68acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:06.411773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1395/2785] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:06.435565 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b457316-bf6b-475c-bf7f-2bcd9958bcd0 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:06.447971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b457316-bf6b-475c-bf7f-2bcd9958bcd0 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:06.453601 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add30104-94b7-4349-82f5-9f7fc25c6082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:06.454259 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add30104-94b7-4349-82f5-9f7fc25c6082 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:06.454537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add30104-94b7-4349-82f5-9f7fc25c6082 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:06.454809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add30104-94b7-4349-82f5-9f7fc25c6082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:06.463396 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add30104-94b7-4349-82f5-9f7fc25c6082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:06.464963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add30104-94b7-4349-82f5-9f7fc25c6082 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:06.474389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1391/2786] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:09.529796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ccc22-7bd2-4fd8-9c52-c0ea7763efd0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.530443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ccc22-7bd2-4fd8-9c52-c0ea7763efd0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.530443 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ccc22-7bd2-4fd8-9c52-c0ea7763efd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.549705 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-452ccc22-7bd2-4fd8-9c52-c0ea7763efd0 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:09.550939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-452ccc22-7bd2-4fd8-9c52-c0ea7763efd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:09.558775 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1396/2787] 10.222.0.97 () {58 vars in 1016 bytes} [Fri Aug 26 15:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:09.580769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add30104-94b7-4349-82f5-9f7fc25c6082 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.592781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add30104-94b7-4349-82f5-9f7fc25c6082 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.598173 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cd1e3-edf3-44ad-8a8c-034d8bd88d06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.598756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cd1e3-edf3-44ad-8a8c-034d8bd88d06 service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.599034 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cd1e3-edf3-44ad-8a8c-034d8bd88d06 service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.599305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cd1e3-edf3-44ad-8a8c-034d8bd88d06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.608170 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cd1e3-edf3-44ad-8a8c-034d8bd88d06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.609732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cd1e3-edf3-44ad-8a8c-034d8bd88d06 service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.620252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1392/2788] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:49:19.545016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=15 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:19.614860 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=30 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:38.632226 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ccc22-7bd2-4fd8-9c52-c0ea7763efd0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:38.645432 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ccc22-7bd2-4fd8-9c52-c0ea7763efd0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:38.650298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:38.651166 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:38.651470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:38.651749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] PATH_INFO: `/v3/users/96b8db29a9324d5fac0569ceed7e1c97` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:38.652940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b8db29a9324d5fac0569ceed7e1c97)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:38.655105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:38.702628 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b8db29a9324d5fac0569ceed7e1c97'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:38.703265 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b8db29a9324d5fac0569ceed7e1c97'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:38.715162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b8db29a9324d5fac0569ceed7e1c97'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:38.721957 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b8db29a9324d5fac0569ceed7e1c97'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:38.722571 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b8db29a9324d5fac0569ceed7e1c97'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:38.735310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1397/2789] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:38 2022] DELETE /identity/v3/users/96b8db29a9324d5fac0569ceed7e1c97 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:38.905019 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cd1e3-edf3-44ad-8a8c-034d8bd88d06 service nova] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:38.916725 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cd1e3-edf3-44ad-8a8c-034d8bd88d06 service nova] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:38.975481 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:38.976345 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:38.977500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:38.977794 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] PATH_INFO: `/v3/projects/cd989272e12649d591714144c7147004` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:38.980117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd989272e12649d591714144c7147004)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:38.982250 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:39.033207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd989272e12649d591714144c7147004', 'request_id': 'req-90c554e1-e0e7-420c-a3e0-a676ada857f7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:39.038884 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd989272e12649d591714144c7147004', 'request_id': 'req-90c554e1-e0e7-420c-a3e0-a676ada857f7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:39.048428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd989272e12649d591714144c7147004', 'request_id': 'req-90c554e1-e0e7-420c-a3e0-a676ada857f7'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:39.060207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] The token cache is being invalidate because project cd989272e12649d591714144c7147004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:39.060497 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:39.061126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:39.062615 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1393/2790] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:38 2022] DELETE /identity/v3/projects/cd989272e12649d591714144c7147004 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:48.731843 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:49.057182 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:54.333958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:54.335842 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:54.352556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9eb02-4588-4100-aba7-9bb35f6c87e6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:54.410543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:54.411188 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:54.411471 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:54.411748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] PATH_INFO: `/v3/users/065f1d6441424ce48ef37c1593ca8d16` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:54.412903 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065f1d6441424ce48ef37c1593ca8d16)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:54.415092 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:54.463854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065f1d6441424ce48ef37c1593ca8d16'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.464825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065f1d6441424ce48ef37c1593ca8d16'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.477441 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065f1d6441424ce48ef37c1593ca8d16'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.486529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065f1d6441424ce48ef37c1593ca8d16'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.487323 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29c4a116-0aec-4741-b665-914707dbf8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065f1d6441424ce48ef37c1593ca8d16'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.500650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1398/2791] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:54 2022] DELETE /identity/v3/users/065f1d6441424ce48ef37c1593ca8d16 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:54.687429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:54.688945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:54.703098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c554e1-e0e7-420c-a3e0-a676ada857f7 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:54.761923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:54.762504 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:54.762786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:54.763061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] PATH_INFO: `/v3/projects/9f57ba32f438432cad998d0152ebc8bd` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:54.764165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f57ba32f438432cad998d0152ebc8bd)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:54.766126 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:54.810661 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f57ba32f438432cad998d0152ebc8bd', 'request_id': 'req-36c64337-8462-4f45-a5ce-781182a42ccc'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.815978 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f57ba32f438432cad998d0152ebc8bd', 'request_id': 'req-36c64337-8462-4f45-a5ce-781182a42ccc'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.823832 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f57ba32f438432cad998d0152ebc8bd', 'request_id': 'req-36c64337-8462-4f45-a5ce-781182a42ccc'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.834750 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] The token cache is being invalidate because project 9f57ba32f438432cad998d0152ebc8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:54.835044 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.835664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-36c64337-8462-4f45-a5ce-781182a42ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:54.837147 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1394/2792] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:54 2022] DELETE /identity/v3/projects/9f57ba32f438432cad998d0152ebc8bd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:54.842953 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7efcc-dc5d-48d0-aa9c-4307e3f66888 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:54.843271 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7efcc-dc5d-48d0-aa9c-4307e3f66888 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:54.843575 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7efcc-dc5d-48d0-aa9c-4307e3f66888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:54.863862 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a0d7efcc-dc5d-48d0-aa9c-4307e3f66888 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:54.865053 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a0d7efcc-dc5d-48d0-aa9c-4307e3f66888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:54.923076 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1399/2793] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:54.931107 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4328-9c47-4e63-b93c-8f42709f8308 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:54.931419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4328-9c47-4e63-b93c-8f42709f8308 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:54.931695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4328-9c47-4e63-b93c-8f42709f8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:54.953219 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-2b3c4328-9c47-4e63-b93c-8f42709f8308 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:54.954469 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2b3c4328-9c47-4e63-b93c-8f42709f8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:54.962373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1395/2794] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:54.967406 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7efcc-dc5d-48d0-aa9c-4307e3f66888 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:54.977201 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7efcc-dc5d-48d0-aa9c-4307e3f66888 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:54.982480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:54.983073 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:54.983353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:54.983623 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:54.984257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:49:54.984554 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:54.986165 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:54.998078 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1400/2795] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:49:55.002429 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4328-9c47-4e63-b93c-8f42709f8308 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.011757 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4328-9c47-4e63-b93c-8f42709f8308 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.016446 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6511c-286f-4a74-9df5-3dfeefc8508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.016979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6511c-286f-4a74-9df5-3dfeefc8508d admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.017256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6511c-286f-4a74-9df5-3dfeefc8508d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.017526 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6511c-286f-4a74-9df5-3dfeefc8508d admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.018179 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6511c-286f-4a74-9df5-3dfeefc8508d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.020069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6511c-286f-4a74-9df5-3dfeefc8508d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.056664 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1396/2796] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:49:55 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:55.061418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.071282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deffbe3-dae9-4b1f-89a4-561b52643087 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.076854 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:55.132639 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54995-b446-429e-aaf0-2442d186382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.133257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54995-b446-429e-aaf0-2442d186382b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.133532 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54995-b446-429e-aaf0-2442d186382b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.133800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db54995-b446-429e-aaf0-2442d186382b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.134442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db54995-b446-429e-aaf0-2442d186382b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.137105 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db54995-b446-429e-aaf0-2442d186382b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.157589 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1401/2797] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:49:55 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:55.161737 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6511c-286f-4a74-9df5-3dfeefc8508d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.172743 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6511c-286f-4a74-9df5-3dfeefc8508d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.177240 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f11ff-412d-4064-8cc9-5c6696a1cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.177886 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f11ff-412d-4064-8cc9-5c6696a1cab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.178165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f11ff-412d-4064-8cc9-5c6696a1cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.178435 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f11ff-412d-4064-8cc9-5c6696a1cab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.179100 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f11ff-412d-4064-8cc9-5c6696a1cab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.180682 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f11ff-412d-4064-8cc9-5c6696a1cab9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.191280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1397/2798] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:55.195273 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54995-b446-429e-aaf0-2442d186382b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.205473 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db54995-b446-429e-aaf0-2442d186382b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.210051 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58549d7-393a-417f-954b-0d1593edd241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.210636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58549d7-393a-417f-954b-0d1593edd241 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.210913 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58549d7-393a-417f-954b-0d1593edd241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.211183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58549d7-393a-417f-954b-0d1593edd241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.211818 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58549d7-393a-417f-954b-0d1593edd241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.213620 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58549d7-393a-417f-954b-0d1593edd241 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.223819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1402/2799] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:55.227979 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f11ff-412d-4064-8cc9-5c6696a1cab9 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.238514 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f11ff-412d-4064-8cc9-5c6696a1cab9 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.243312 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d30dd-3a00-43d2-9f6a-a7e99c5e3c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.243941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d30dd-3a00-43d2-9f6a-a7e99c5e3c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.244269 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d30dd-3a00-43d2-9f6a-a7e99c5e3c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.244702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d30dd-3a00-43d2-9f6a-a7e99c5e3c75 admin admin] PATH_INFO: `/v3/projects/895f4e7c0a364b128cf922d01ca08f0e/users/6fe8b919c69b48b38b721a8e09796c9a/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.260693 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d30dd-3a00-43d2-9f6a-a7e99c5e3c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895f4e7c0a364b128cf922d01ca08f0e, user_id=6fe8b919c69b48b38b721a8e09796c9a, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.263384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d30dd-3a00-43d2-9f6a-a7e99c5e3c75 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.276421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1398/2800] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:55 2022] PUT /identity/v3/projects/895f4e7c0a364b128cf922d01ca08f0e/users/6fe8b919c69b48b38b721a8e09796c9a/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:55.288654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3411-6612-4c26-9219-d84d8e201218 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.288937 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3411-6612-4c26-9219-d84d8e201218 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.289209 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3411-6612-4c26-9219-d84d8e201218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.317852 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e1ef3411-6612-4c26-9219-d84d8e201218 None None] MFA Rules not processed for user `6fe8b919c69b48b38b721a8e09796c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:55.319195 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1ef3411-6612-4c26-9219-d84d8e201218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:55.381640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1403/2801] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:49:55.387008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d30dd-3a00-43d2-9f6a-a7e99c5e3c75 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.407185 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:55.451600 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d30dd-3a00-43d2-9f6a-a7e99c5e3c75 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.456160 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a2ea0-d7d7-4b6e-bc31-81fc25d32c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.456779 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a2ea0-d7d7-4b6e-bc31-81fc25d32c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.457055 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a2ea0-d7d7-4b6e-bc31-81fc25d32c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.457326 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a2ea0-d7d7-4b6e-bc31-81fc25d32c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.457952 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a2ea0-d7d7-4b6e-bc31-81fc25d32c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.459831 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a2ea0-d7d7-4b6e-bc31-81fc25d32c8c admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.486483 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1399/2802] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:49:55 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:55.490546 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3411-6612-4c26-9219-d84d8e201218 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.502254 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3411-6612-4c26-9219-d84d8e201218 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.558791 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6ff1-677d-44dd-b8c4-7a3f2e81b7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.559318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6ff1-677d-44dd-b8c4-7a3f2e81b7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.559600 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6ff1-677d-44dd-b8c4-7a3f2e81b7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.559875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c6ff1-677d-44dd-b8c4-7a3f2e81b7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.560503 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c6ff1-677d-44dd-b8c4-7a3f2e81b7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.562457 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c6ff1-677d-44dd-b8c4-7a3f2e81b7d7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.584040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1404/2803] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:49:55 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:55.588371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a2ea0-d7d7-4b6e-bc31-81fc25d32c8c admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.598721 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a2ea0-d7d7-4b6e-bc31-81fc25d32c8c admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.603530 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a93b56-9217-42a8-b022-3479f505d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.604352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93b56-9217-42a8-b022-3479f505d29f admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.604633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93b56-9217-42a8-b022-3479f505d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.604912 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93b56-9217-42a8-b022-3479f505d29f admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.605551 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a93b56-9217-42a8-b022-3479f505d29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.607186 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a93b56-9217-42a8-b022-3479f505d29f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.617983 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1400/2804] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:55.622748 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6ff1-677d-44dd-b8c4-7a3f2e81b7d7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.628955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:55.632733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c6ff1-677d-44dd-b8c4-7a3f2e81b7d7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.640214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eba719-82eb-4555-994b-5182686f1afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.640863 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eba719-82eb-4555-994b-5182686f1afb admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.641145 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eba719-82eb-4555-994b-5182686f1afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.641428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eba719-82eb-4555-994b-5182686f1afb admin admin] PATH_INFO: `/v3/projects/56b6dd15edef45dca13e760cf4aa38a1/users/9b8d8003962640f38c040db5d70f8494/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.655974 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eba719-82eb-4555-994b-5182686f1afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b6dd15edef45dca13e760cf4aa38a1, user_id=9b8d8003962640f38c040db5d70f8494, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.658669 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eba719-82eb-4555-994b-5182686f1afb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.671152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1405/2805] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:55 2022] PUT /identity/v3/projects/56b6dd15edef45dca13e760cf4aa38a1/users/9b8d8003962640f38c040db5d70f8494/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:55.675057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a93b56-9217-42a8-b022-3479f505d29f admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.685966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a93b56-9217-42a8-b022-3479f505d29f admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.742769 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca142969-a9a6-4468-8e9c-449f0aacec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.743399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca142969-a9a6-4468-8e9c-449f0aacec63 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.743656 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca142969-a9a6-4468-8e9c-449f0aacec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.743925 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca142969-a9a6-4468-8e9c-449f0aacec63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.745323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca142969-a9a6-4468-8e9c-449f0aacec63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.747001 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca142969-a9a6-4468-8e9c-449f0aacec63 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.756540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1401/2806] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:55.761321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eba719-82eb-4555-994b-5182686f1afb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.771439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eba719-82eb-4555-994b-5182686f1afb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.776066 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.776703 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.776982 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.777256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] PATH_INFO: `/v3/projects/56b6dd15edef45dca13e760cf4aa38a1/users/9b8d8003962640f38c040db5d70f8494/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.779221 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b6dd15edef45dca13e760cf4aa38a1, user_id=9b8d8003962640f38c040db5d70f8494, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:55.781859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:55.791779 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1406/2807] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:55 2022] PUT /identity/v3/projects/56b6dd15edef45dca13e760cf4aa38a1/users/9b8d8003962640f38c040db5d70f8494/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:55.803008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c63836-cd08-45c7-96a7-352dfee611c2 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.803297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c63836-cd08-45c7-96a7-352dfee611c2 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.803575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c63836-cd08-45c7-96a7-352dfee611c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:55.831974 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-26c63836-cd08-45c7-96a7-352dfee611c2 None None] MFA Rules not processed for user `9b8d8003962640f38c040db5d70f8494`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:55.833175 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-26c63836-cd08-45c7-96a7-352dfee611c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:55.899196 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1402/2808] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:55.910596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:55.912263 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:55.990465 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f00c5-4012-4e99-9c03-5a3432bb2e32 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:55.995010 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193d48-c92b-4ab5-9190-d3b4ed061b70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:55.995606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193d48-c92b-4ab5-9190-d3b4ed061b70 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:55.995881 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193d48-c92b-4ab5-9190-d3b4ed061b70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:55.996149 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193d48-c92b-4ab5-9190-d3b4ed061b70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:56.049464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193d48-c92b-4ab5-9190-d3b4ed061b70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:56.050926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193d48-c92b-4ab5-9190-d3b4ed061b70 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:56.060227 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1407/2809] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:57.424295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c63836-cd08-45c7-96a7-352dfee611c2 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:57.425677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-26c63836-cd08-45c7-96a7-352dfee611c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:57.438125 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c63836-cd08-45c7-96a7-352dfee611c2 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:57.441592 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc57217-9e7e-41f5-a4db-737f4eb4ac13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:57.442227 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc57217-9e7e-41f5-a4db-737f4eb4ac13 service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:57.442507 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc57217-9e7e-41f5-a4db-737f4eb4ac13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:57.442778 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc57217-9e7e-41f5-a4db-737f4eb4ac13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:57.452323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc57217-9e7e-41f5-a4db-737f4eb4ac13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:57.453756 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc57217-9e7e-41f5-a4db-737f4eb4ac13 service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:57.458702 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:57.464039 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1403/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:01.215040 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193d48-c92b-4ab5-9190-d3b4ed061b70 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:01.277155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193d48-c92b-4ab5-9190-d3b4ed061b70 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:01.281663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:01.282317 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:01.282599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:01.282876 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] PATH_INFO: `/v3/users/6fe8b919c69b48b38b721a8e09796c9a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:01.283983 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe8b919c69b48b38b721a8e09796c9a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:01.285911 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:01.288217 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:01.332742 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe8b919c69b48b38b721a8e09796c9a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.333374 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe8b919c69b48b38b721a8e09796c9a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.345032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe8b919c69b48b38b721a8e09796c9a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.351815 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe8b919c69b48b38b721a8e09796c9a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.352474 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe8b919c69b48b38b721a8e09796c9a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.365155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1408/2811] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:50:01 2022] DELETE /identity/v3/users/6fe8b919c69b48b38b721a8e09796c9a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:01.370706 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb54b7-75a5-4182-8ff9-d0d68ca8f4b8 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:01.371209 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb54b7-75a5-4182-8ff9-d0d68ca8f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:01.371308 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb54b7-75a5-4182-8ff9-d0d68ca8f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:01.390069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3bbb54b7-75a5-4182-8ff9-d0d68ca8f4b8 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:01.391210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3bbb54b7-75a5-4182-8ff9-d0d68ca8f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:01.449653 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1404/2812] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:01.459416 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:01.460808 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:01.537480 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a952080-67bb-45a0-9386-4479aacf7127 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:01.541894 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fc12-a0bc-4a2f-b645-214f67e20e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:01.542535 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fc12-a0bc-4a2f-b645-214f67e20e3f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:01.542816 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fc12-a0bc-4a2f-b645-214f67e20e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:01.543095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5fc12-a0bc-4a2f-b645-214f67e20e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:01.552275 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5fc12-a0bc-4a2f-b645-214f67e20e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:01.553708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5fc12-a0bc-4a2f-b645-214f67e20e3f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:01.563582 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1409/2813] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:01.825991 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb54b7-75a5-4182-8ff9-d0d68ca8f4b8 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:01.827473 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3bbb54b7-75a5-4182-8ff9-d0d68ca8f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:01.840245 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb54b7-75a5-4182-8ff9-d0d68ca8f4b8 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:01.845059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:01.845729 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:01.846675 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:01.846959 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] PATH_INFO: `/v3/projects/895f4e7c0a364b128cf922d01ca08f0e` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:01.848355 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895f4e7c0a364b128cf922d01ca08f0e)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:01.850267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:01.897852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895f4e7c0a364b128cf922d01ca08f0e', 'request_id': 'req-f6ac7e7b-5e14-4757-be35-1d03f251ff15'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.903677 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895f4e7c0a364b128cf922d01ca08f0e', 'request_id': 'req-f6ac7e7b-5e14-4757-be35-1d03f251ff15'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.910986 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895f4e7c0a364b128cf922d01ca08f0e', 'request_id': 'req-f6ac7e7b-5e14-4757-be35-1d03f251ff15'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.922544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] The token cache is being invalidate because project 895f4e7c0a364b128cf922d01ca08f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:50:01.922835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.923462 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:01.924921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1405/2814] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:50:01 2022] DELETE /identity/v3/projects/895f4e7c0a364b128cf922d01ca08f0e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:01.928882 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fc12-a0bc-4a2f-b645-214f67e20e3f service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:01.939085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5fc12-a0bc-4a2f-b645-214f67e20e3f service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:01.999155 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:01.999774 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.000056 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.000332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] PATH_INFO: `/v3/users/9b8d8003962640f38c040db5d70f8494` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.001456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8d8003962640f38c040db5d70f8494)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:02.003525 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:02.008998 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.052713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8d8003962640f38c040db5d70f8494'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.053354 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8d8003962640f38c040db5d70f8494'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.065670 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8d8003962640f38c040db5d70f8494'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.073110 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8d8003962640f38c040db5d70f8494'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.073723 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ef5c5c4-756b-45f6-be78-16815dfbfe8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8d8003962640f38c040db5d70f8494'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.085697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1410/2815] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:50:01 2022] DELETE /identity/v3/users/9b8d8003962640f38c040db5d70f8494 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:02.366580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:02.368305 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:02.382584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7e7b-5e14-4757-be35-1d03f251ff15 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:02.442366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:02.442911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.443192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.443465 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] PATH_INFO: `/v3/projects/56b6dd15edef45dca13e760cf4aa38a1` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.444571 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b6dd15edef45dca13e760cf4aa38a1)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:02.446524 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:02.476563 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.495220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b6dd15edef45dca13e760cf4aa38a1', 'request_id': 'req-9c9c1990-c812-4fdc-8374-4ef2e855fa77'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.500716 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b6dd15edef45dca13e760cf4aa38a1', 'request_id': 'req-9c9c1990-c812-4fdc-8374-4ef2e855fa77'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.507770 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b6dd15edef45dca13e760cf4aa38a1', 'request_id': 'req-9c9c1990-c812-4fdc-8374-4ef2e855fa77'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.519454 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] The token cache is being invalidate because project 56b6dd15edef45dca13e760cf4aa38a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:50:02.519744 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.520370 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-9c9c1990-c812-4fdc-8374-4ef2e855fa77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:02.521923 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1406/2816] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:50:02 2022] DELETE /identity/v3/projects/56b6dd15edef45dca13e760cf4aa38a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:02.527538 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c18f-76dc-4fa6-8a77-30e8c199b370 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.528080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c18f-76dc-4fa6-8a77-30e8c199b370 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.528080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744c18f-76dc-4fa6-8a77-30e8c199b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.547581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0744c18f-76dc-4fa6-8a77-30e8c199b370 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:02.548768 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0744c18f-76dc-4fa6-8a77-30e8c199b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:02.606886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1411/2817] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:02.614835 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd1365-4586-490f-ab60-44d74dd7a82a None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.615117 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd1365-4586-490f-ab60-44d74dd7a82a None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.615389 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd1365-4586-490f-ab60-44d74dd7a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.635951 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-b3cd1365-4586-490f-ab60-44d74dd7a82a None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:02.637676 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-b3cd1365-4586-490f-ab60-44d74dd7a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:02.647150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1407/2818] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:02.651875 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744c18f-76dc-4fa6-8a77-30e8c199b370 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:02.661544 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744c18f-76dc-4fa6-8a77-30e8c199b370 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:02.666697 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:02.667485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.667767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.668036 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.668708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:50:02.669006 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:02.670636 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:02.683385 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1412/2819] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:50:02.687856 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd1365-4586-490f-ab60-44d74dd7a82a None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:02.699949 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd1365-4586-490f-ab60-44d74dd7a82a None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:02.707814 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4d41f-8872-4efb-a9ac-3ce620c988ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:02.708421 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d41f-8872-4efb-a9ac-3ce620c988ba admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.708724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d41f-8872-4efb-a9ac-3ce620c988ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.709106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d41f-8872-4efb-a9ac-3ce620c988ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.709748 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4d41f-8872-4efb-a9ac-3ce620c988ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:02.711699 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4d41f-8872-4efb-a9ac-3ce620c988ba admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:02.740334 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1408/2820] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:50:02 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:02.745794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:02.755618 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4fd3-4100-4dbd-8436-a3a57e524d82 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:02.810733 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a052c-522a-439a-b889-1239a47292c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:02.811331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a052c-522a-439a-b889-1239a47292c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.811613 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a052c-522a-439a-b889-1239a47292c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.811885 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a052c-522a-439a-b889-1239a47292c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.812504 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a052c-522a-439a-b889-1239a47292c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:02.814435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a052c-522a-439a-b889-1239a47292c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:02.830996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:02.836679 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1413/2821] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:50:02 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:02.841280 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4d41f-8872-4efb-a9ac-3ce620c988ba admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:02.851640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4d41f-8872-4efb-a9ac-3ce620c988ba admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:02.857040 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc15d1-0697-4814-bf74-1dcce40c1b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:02.857640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc15d1-0697-4814-bf74-1dcce40c1b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.857958 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc15d1-0697-4814-bf74-1dcce40c1b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.858233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc15d1-0697-4814-bf74-1dcce40c1b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.858875 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc15d1-0697-4814-bf74-1dcce40c1b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:02.860467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc15d1-0697-4814-bf74-1dcce40c1b1a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:02.871141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1409/2822] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:02.875063 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a052c-522a-439a-b889-1239a47292c5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:02.885065 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a052c-522a-439a-b889-1239a47292c5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:02.889930 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae2b29-293c-4c83-9b90-968d60ed1cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:02.890516 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b29-293c-4c83-9b90-968d60ed1cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.890793 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b29-293c-4c83-9b90-968d60ed1cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.891060 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b29-293c-4c83-9b90-968d60ed1cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.891714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae2b29-293c-4c83-9b90-968d60ed1cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:02.893282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae2b29-293c-4c83-9b90-968d60ed1cc5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:02.903801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1414/2823] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:02.907941 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc15d1-0697-4814-bf74-1dcce40c1b1a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:02.918544 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc15d1-0697-4814-bf74-1dcce40c1b1a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:02.923207 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01066-6c7e-4bbe-9fcd-8a1b6c85367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:02.923847 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01066-6c7e-4bbe-9fcd-8a1b6c85367e admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.924129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01066-6c7e-4bbe-9fcd-8a1b6c85367e admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.924405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01066-6c7e-4bbe-9fcd-8a1b6c85367e admin admin] PATH_INFO: `/v3/projects/60a65808456d4ed58bda36506aaf6c39/users/3310de2d93a74d5cab6b210d8067a462/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.940017 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01066-6c7e-4bbe-9fcd-8a1b6c85367e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a65808456d4ed58bda36506aaf6c39, user_id=3310de2d93a74d5cab6b210d8067a462, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:02.942730 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01066-6c7e-4bbe-9fcd-8a1b6c85367e admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:02.957594 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1410/2824] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:50:02 2022] PUT /identity/v3/projects/60a65808456d4ed58bda36506aaf6c39/users/3310de2d93a74d5cab6b210d8067a462/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:02.969867 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabbb2-3261-490b-a1e5-e9e58d69d48e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:02.970159 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabbb2-3261-490b-a1e5-e9e58d69d48e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:02.970461 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabbb2-3261-490b-a1e5-e9e58d69d48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:02.999627 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-94eabbb2-3261-490b-a1e5-e9e58d69d48e None None] MFA Rules not processed for user `3310de2d93a74d5cab6b210d8067a462`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:03.000839 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-94eabbb2-3261-490b-a1e5-e9e58d69d48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:03.070228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1415/2825] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:03.075550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01066-6c7e-4bbe-9fcd-8a1b6c85367e admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:03.139919 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01066-6c7e-4bbe-9fcd-8a1b6c85367e admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:03.144613 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cdc60-a404-4b36-b5b3-baea0b408824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:03.145215 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cdc60-a404-4b36-b5b3-baea0b408824 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:03.145502 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cdc60-a404-4b36-b5b3-baea0b408824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:03.145777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cdc60-a404-4b36-b5b3-baea0b408824 admin admin] PATH_INFO: `/v3/projects` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:03.146432 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cdc60-a404-4b36-b5b3-baea0b408824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:03.148356 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cdc60-a404-4b36-b5b3-baea0b408824 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:03.177053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1411/2826] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:50:03 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:03.181181 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eabbb2-3261-490b-a1e5-e9e58d69d48e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:03.191966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eabbb2-3261-490b-a1e5-e9e58d69d48e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:03.247903 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b673e-efc2-457d-9471-13fa98e88530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:03.248429 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b673e-efc2-457d-9471-13fa98e88530 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:03.248713 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b673e-efc2-457d-9471-13fa98e88530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:03.249017 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b673e-efc2-457d-9471-13fa98e88530 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:03.249640 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b673e-efc2-457d-9471-13fa98e88530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:03.251597 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b673e-efc2-457d-9471-13fa98e88530 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:03.272988 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1416/2827] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:50:03 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:03.277545 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cdc60-a404-4b36-b5b3-baea0b408824 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:03.287767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cdc60-a404-4b36-b5b3-baea0b408824 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:03.293059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67180e7-db78-467e-bd5d-a827b851fae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:03.293655 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67180e7-db78-467e-bd5d-a827b851fae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:03.293966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67180e7-db78-467e-bd5d-a827b851fae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:03.294271 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67180e7-db78-467e-bd5d-a827b851fae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:03.294921 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67180e7-db78-467e-bd5d-a827b851fae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:03.296520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67180e7-db78-467e-bd5d-a827b851fae8 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:03.306985 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1412/2828] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:03.311162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b673e-efc2-457d-9471-13fa98e88530 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:03.320952 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b673e-efc2-457d-9471-13fa98e88530 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:03.326543 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92585887-982a-4ce6-8ab7-c6ef9b440248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:03.327183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585887-982a-4ce6-8ab7-c6ef9b440248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:03.327458 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585887-982a-4ce6-8ab7-c6ef9b440248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:03.327759 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585887-982a-4ce6-8ab7-c6ef9b440248 admin admin] PATH_INFO: `/v3/projects/55c1abf015eb44959ee0a3311e8ffd54/users/a4d33a19a8b34072a9ada4a509368196/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:03.342817 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92585887-982a-4ce6-8ab7-c6ef9b440248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c1abf015eb44959ee0a3311e8ffd54, user_id=a4d33a19a8b34072a9ada4a509368196, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:03.345470 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92585887-982a-4ce6-8ab7-c6ef9b440248 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:03.357886 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1417/2829] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:50:03 2022] PUT /identity/v3/projects/55c1abf015eb44959ee0a3311e8ffd54/users/a4d33a19a8b34072a9ada4a509368196/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:03.361776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67180e7-db78-467e-bd5d-a827b851fae8 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:03.371972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67180e7-db78-467e-bd5d-a827b851fae8 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:03.391945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:03.431009 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abdfeb-91a8-4a47-89f6-5a491eb9e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:03.432290 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abdfeb-91a8-4a47-89f6-5a491eb9e90d admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:03.432537 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abdfeb-91a8-4a47-89f6-5a491eb9e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:03.432836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abdfeb-91a8-4a47-89f6-5a491eb9e90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:03.433505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abdfeb-91a8-4a47-89f6-5a491eb9e90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:03.435199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abdfeb-91a8-4a47-89f6-5a491eb9e90d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:03.445199 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1413/2830] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:03.449550 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92585887-982a-4ce6-8ab7-c6ef9b440248 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:03.459796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92585887-982a-4ce6-8ab7-c6ef9b440248 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:03.464477 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:03.465117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:03.465397 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:03.465673 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] PATH_INFO: `/v3/projects/55c1abf015eb44959ee0a3311e8ffd54/users/a4d33a19a8b34072a9ada4a509368196/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:03.467605 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c1abf015eb44959ee0a3311e8ffd54, user_id=a4d33a19a8b34072a9ada4a509368196, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:03.470276 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:03.481002 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1418/2831] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:50:03 2022] PUT /identity/v3/projects/55c1abf015eb44959ee0a3311e8ffd54/users/a4d33a19a8b34072a9ada4a509368196/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:03.491067 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b428-bc03-4379-a3cc-535fd3275f45 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:03.491359 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b428-bc03-4379-a3cc-535fd3275f45 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:03.491634 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b428-bc03-4379-a3cc-535fd3275f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:03.519618 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-04e7b428-bc03-4379-a3cc-535fd3275f45 None None] MFA Rules not processed for user `a4d33a19a8b34072a9ada4a509368196`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:03.520808 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-04e7b428-bc03-4379-a3cc-535fd3275f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:03.587904 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1414/2832] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:03.598442 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:03.600199 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:03.634609 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:03.665212 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b347a-20fa-4dc4-87fb-388869de587c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:03.669111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a229be-ed76-47f8-a7c3-bea049a01493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:03.669714 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a229be-ed76-47f8-a7c3-bea049a01493 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:03.670032 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a229be-ed76-47f8-a7c3-bea049a01493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:03.670310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a229be-ed76-47f8-a7c3-bea049a01493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:03.679168 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a229be-ed76-47f8-a7c3-bea049a01493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:03.680608 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a229be-ed76-47f8-a7c3-bea049a01493 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:03.690200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1419/2833] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:50:04.235267 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7b428-bc03-4379-a3cc-535fd3275f45 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:04.297519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7b428-bc03-4379-a3cc-535fd3275f45 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:04.302043 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:04.302611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:04.302897 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:04.303168 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] PATH_INFO: `/v3/users/3310de2d93a74d5cab6b210d8067a462` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:04.304275 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3310de2d93a74d5cab6b210d8067a462)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:04.306225 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:04.353162 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3310de2d93a74d5cab6b210d8067a462'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.354426 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3310de2d93a74d5cab6b210d8067a462'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.355580 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:04.368002 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3310de2d93a74d5cab6b210d8067a462'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.375492 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3310de2d93a74d5cab6b210d8067a462'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.376135 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3310de2d93a74d5cab6b210d8067a462'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.388477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1415/2834] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:50:04 2022] DELETE /identity/v3/users/3310de2d93a74d5cab6b210d8067a462 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:04.392965 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4833c-8ffb-433b-88d1-100c2393ebcc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:04.393250 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4833c-8ffb-433b-88d1-100c2393ebcc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:04.393522 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4833c-8ffb-433b-88d1-100c2393ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:04.411900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-87b4833c-8ffb-433b-88d1-100c2393ebcc None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:04.413100 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-87b4833c-8ffb-433b-88d1-100c2393ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:04.470720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1420/2835] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:04.481008 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:04.482453 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:04.538762 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de50d4-fdad-498b-b1a2-2d943439db67 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:04.543198 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb995-b756-46b3-8841-5c26b5401340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:04.543781 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb995-b756-46b3-8841-5c26b5401340 service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:04.544063 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb995-b756-46b3-8841-5c26b5401340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:04.544335 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb995-b756-46b3-8841-5c26b5401340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:04.553376 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb995-b756-46b3-8841-5c26b5401340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:04.554776 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb995-b756-46b3-8841-5c26b5401340 service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:04.564662 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1416/2836] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:04.839050 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4833c-8ffb-433b-88d1-100c2393ebcc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:04.840479 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-87b4833c-8ffb-433b-88d1-100c2393ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:04.852335 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4833c-8ffb-433b-88d1-100c2393ebcc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:04.858099 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:04.858719 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:04.858995 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:04.859266 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] PATH_INFO: `/v3/projects/60a65808456d4ed58bda36506aaf6c39` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:04.860377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a65808456d4ed58bda36506aaf6c39)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:04.862285 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:04.908802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a65808456d4ed58bda36506aaf6c39', 'request_id': 'req-7d909799-afcd-41f9-b304-8ed334d94804'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.917451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a65808456d4ed58bda36506aaf6c39', 'request_id': 'req-7d909799-afcd-41f9-b304-8ed334d94804'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.922940 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a65808456d4ed58bda36506aaf6c39', 'request_id': 'req-7d909799-afcd-41f9-b304-8ed334d94804'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.934603 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] The token cache is being invalidate because project 60a65808456d4ed58bda36506aaf6c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:50:04.934887 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.935510 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:04.936968 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1421/2837] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:50:04 2022] DELETE /identity/v3/projects/60a65808456d4ed58bda36506aaf6c39 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:04.940946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb995-b756-46b3-8841-5c26b5401340 service neutron] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:04.950649 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb995-b756-46b3-8841-5c26b5401340 service neutron] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:05.010488 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:05.011283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.011569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.011846 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] PATH_INFO: `/v3/users/a4d33a19a8b34072a9ada4a509368196` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.012963 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d33a19a8b34072a9ada4a509368196)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:05.014936 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:05.059646 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d33a19a8b34072a9ada4a509368196'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.060286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d33a19a8b34072a9ada4a509368196'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.072529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d33a19a8b34072a9ada4a509368196'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.076329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:05.081381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d33a19a8b34072a9ada4a509368196'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.082281 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-784b8ca4-4551-4d9b-8dfa-9019de934105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d33a19a8b34072a9ada4a509368196'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.096066 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1417/2838] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:50:04 2022] DELETE /identity/v3/users/a4d33a19a8b34072a9ada4a509368196 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:05.370237 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:05.372280 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:05.386807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909799-afcd-41f9-b304-8ed334d94804 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:05.443655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:05.450962 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:05.451633 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.452125 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.452807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] PATH_INFO: `/v3/projects/55c1abf015eb44959ee0a3311e8ffd54` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.453958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c1abf015eb44959ee0a3311e8ffd54)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:05.456322 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:05.501450 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c1abf015eb44959ee0a3311e8ffd54', 'request_id': 'req-499810c1-944b-4a75-ac6d-38668b1da2c3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.508152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c1abf015eb44959ee0a3311e8ffd54', 'request_id': 'req-499810c1-944b-4a75-ac6d-38668b1da2c3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.514293 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c1abf015eb44959ee0a3311e8ffd54', 'request_id': 'req-499810c1-944b-4a75-ac6d-38668b1da2c3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.525678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] The token cache is being invalidate because project 55c1abf015eb44959ee0a3311e8ffd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:50:05.525996 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.526654 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-499810c1-944b-4a75-ac6d-38668b1da2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:05.528117 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1422/2839] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:50:05 2022] DELETE /identity/v3/projects/55c1abf015eb44959ee0a3311e8ffd54 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:50:05.533150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8321-3d3e-4bc1-8775-60a25aea2eed None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.533611 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8321-3d3e-4bc1-8775-60a25aea2eed None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.533726 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8321-3d3e-4bc1-8775-60a25aea2eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.554433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-613e8321-3d3e-4bc1-8775-60a25aea2eed None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:05.555641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-613e8321-3d3e-4bc1-8775-60a25aea2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:05.614193 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1418/2840] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:05.623796 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba518e25-09f8-4f5b-a2aa-390060ead2a7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.624085 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba518e25-09f8-4f5b-a2aa-390060ead2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.624360 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba518e25-09f8-4f5b-a2aa-390060ead2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.646162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ba518e25-09f8-4f5b-a2aa-390060ead2a7 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:05.647404 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ba518e25-09f8-4f5b-a2aa-390060ead2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:05.655413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1423/2841] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:05.659786 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8321-3d3e-4bc1-8775-60a25aea2eed None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:05.670231 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8321-3d3e-4bc1-8775-60a25aea2eed None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:05.674709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:05.675297 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.675575 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.675845 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.676480 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:50:05.676892 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:05.678533 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:05.690384 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1419/2842] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:50:05.694603 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba518e25-09f8-4f5b-a2aa-390060ead2a7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:05.704598 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba518e25-09f8-4f5b-a2aa-390060ead2a7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:05.709198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbe82a-ed36-4200-94cd-f3636aab71ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:05.709786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe82a-ed36-4200-94cd-f3636aab71ab admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.710095 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe82a-ed36-4200-94cd-f3636aab71ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.710371 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe82a-ed36-4200-94cd-f3636aab71ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.711000 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbe82a-ed36-4200-94cd-f3636aab71ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:05.713645 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbe82a-ed36-4200-94cd-f3636aab71ab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:05.740708 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1424/2843] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:50:05 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:05.745235 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:05.755390 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decab35-b48b-4510-b2b5-6d984475e8f8 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:05.810992 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bbc1-57b7-42a4-bcb3-129e36bec93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:05.811593 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bbc1-57b7-42a4-bcb3-129e36bec93d admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.811902 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bbc1-57b7-42a4-bcb3-129e36bec93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.812176 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bbc1-57b7-42a4-bcb3-129e36bec93d admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.812799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1bbc1-57b7-42a4-bcb3-129e36bec93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:05.814780 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1bbc1-57b7-42a4-bcb3-129e36bec93d admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:05.835660 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1420/2844] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:50:05 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:50:05.840773 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbe82a-ed36-4200-94cd-f3636aab71ab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:05.851027 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbe82a-ed36-4200-94cd-f3636aab71ab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:05.855802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d30d-b3de-4e01-8711-7746e954dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:05.856396 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d30d-b3de-4e01-8711-7746e954dc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.856675 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d30d-b3de-4e01-8711-7746e954dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.856946 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d30d-b3de-4e01-8711-7746e954dc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.857587 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d30d-b3de-4e01-8711-7746e954dc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:05.859218 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d30d-b3de-4e01-8711-7746e954dc2e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:05.869294 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1425/2845] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:05.873180 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bbc1-57b7-42a4-bcb3-129e36bec93d admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:05.883121 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bbc1-57b7-42a4-bcb3-129e36bec93d admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:05.888382 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bec1d9-727f-4eec-8773-e19eaa9bb927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:05.888968 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec1d9-727f-4eec-8773-e19eaa9bb927 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.889246 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec1d9-727f-4eec-8773-e19eaa9bb927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.889519 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bec1d9-727f-4eec-8773-e19eaa9bb927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.890194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bec1d9-727f-4eec-8773-e19eaa9bb927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:05.891777 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bec1d9-727f-4eec-8773-e19eaa9bb927 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:05.902774 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1421/2846] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:05.906849 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d30d-b3de-4e01-8711-7746e954dc2e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:05.917529 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d30d-b3de-4e01-8711-7746e954dc2e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:05.922054 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:05.923071 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.923380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.923644 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] PATH_INFO: `/v3/projects/fbd24cd4d3074fd38c6d24b58c8850ab/users/f0658e406bb546e3b8c10a23c74bd33d/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.939540 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd24cd4d3074fd38c6d24b58c8850ab, user_id=f0658e406bb546e3b8c10a23c74bd33d, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:05.942256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:05.956370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1426/2847] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:50:05 2022] PUT /identity/v3/projects/fbd24cd4d3074fd38c6d24b58c8850ab/users/f0658e406bb546e3b8c10a23c74bd33d/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:05.961373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dc201-444f-4298-8fa4-78434b70e8e4 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:05.961658 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dc201-444f-4298-8fa4-78434b70e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:05.961967 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dc201-444f-4298-8fa4-78434b70e8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:05.981362 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-651dc201-444f-4298-8fa4-78434b70e8e4 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:05.982581 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-651dc201-444f-4298-8fa4-78434b70e8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:06.029865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:06.043499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1422/2848] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:06.053098 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:06.054869 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:06.110857 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58894fcf-e984-412c-9be3-57e7ad029ed3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:06.114423 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baeb94a-d31f-46ec-8b32-db9b0238c04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:06.115019 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeb94a-d31f-46ec-8b32-db9b0238c04b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:06.115327 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeb94a-d31f-46ec-8b32-db9b0238c04b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:06.115602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baeb94a-d31f-46ec-8b32-db9b0238c04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:06.125321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baeb94a-d31f-46ec-8b32-db9b0238c04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:06.126720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baeb94a-d31f-46ec-8b32-db9b0238c04b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:06.137439 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1427/2849] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:06.837106 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe36a2-aa34-4ca4-b42f-b98cfae7a967 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:06.838343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe36a2-aa34-4ca4-b42f-b98cfae7a967 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:06.838343 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe36a2-aa34-4ca4-b42f-b98cfae7a967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:06.866550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-22fe36a2-aa34-4ca4-b42f-b98cfae7a967 None None] MFA Rules not processed for user `f0658e406bb546e3b8c10a23c74bd33d`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:06.868038 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-22fe36a2-aa34-4ca4-b42f-b98cfae7a967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:06.934807 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1423/2850] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:06.939334 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baeb94a-d31f-46ec-8b32-db9b0238c04b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:06.949692 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baeb94a-d31f-46ec-8b32-db9b0238c04b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:06.954234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db6299-008d-476a-aa63-4b83a5682eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:06.954912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db6299-008d-476a-aa63-4b83a5682eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:06.955257 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db6299-008d-476a-aa63-4b83a5682eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:06.955594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db6299-008d-476a-aa63-4b83a5682eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:06.956289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db6299-008d-476a-aa63-4b83a5682eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:06.958282 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db6299-008d-476a-aa63-4b83a5682eb9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:06.985399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1428/2851] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:50:06 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:06.989471 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe36a2-aa34-4ca4-b42f-b98cfae7a967 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:07.001047 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe36a2-aa34-4ca4-b42f-b98cfae7a967 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:07.059854 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9794-7b21-4776-a673-221778269548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:07.060457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9794-7b21-4776-a673-221778269548 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:07.060741 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9794-7b21-4776-a673-221778269548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:07.061016 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9794-7b21-4776-a673-221778269548 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:07.061631 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9794-7b21-4776-a673-221778269548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:07.063596 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9794-7b21-4776-a673-221778269548 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:07.083820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1424/2852] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:50:06 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:07.088966 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db6299-008d-476a-aa63-4b83a5682eb9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:07.095601 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:07.099801 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db6299-008d-476a-aa63-4b83a5682eb9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:07.105865 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dfb8d-412a-4044-b3d3-43667e7583e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:07.106656 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dfb8d-412a-4044-b3d3-43667e7583e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:07.107119 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dfb8d-412a-4044-b3d3-43667e7583e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:07.107556 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dfb8d-412a-4044-b3d3-43667e7583e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:07.108207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dfb8d-412a-4044-b3d3-43667e7583e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:07.109787 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dfb8d-412a-4044-b3d3-43667e7583e3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:07.120917 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1429/2853] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:07.125131 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9794-7b21-4776-a673-221778269548 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:07.136092 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9794-7b21-4776-a673-221778269548 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:07.140877 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af62f2-6b52-45dd-a07d-2905dae25433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:07.141525 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af62f2-6b52-45dd-a07d-2905dae25433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:07.141799 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af62f2-6b52-45dd-a07d-2905dae25433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:07.142097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af62f2-6b52-45dd-a07d-2905dae25433 admin admin] PATH_INFO: `/v3/projects/7998cb728b7d419791a59902c36aac08/users/96ca48ad9e454c4ab94d79b0b4a948cf/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:07.157408 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af62f2-6b52-45dd-a07d-2905dae25433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7998cb728b7d419791a59902c36aac08, user_id=96ca48ad9e454c4ab94d79b0b4a948cf, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:07.160059 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af62f2-6b52-45dd-a07d-2905dae25433 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:07.172906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1425/2854] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:50:07 2022] PUT /identity/v3/projects/7998cb728b7d419791a59902c36aac08/users/96ca48ad9e454c4ab94d79b0b4a948cf/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:07.176889 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dfb8d-412a-4044-b3d3-43667e7583e3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:07.187029 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dfb8d-412a-4044-b3d3-43667e7583e3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:07.243472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd82ac-8e45-4f01-9e31-59c4d04bcdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:07.244234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd82ac-8e45-4f01-9e31-59c4d04bcdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:07.244647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd82ac-8e45-4f01-9e31-59c4d04bcdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:07.244924 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd82ac-8e45-4f01-9e31-59c4d04bcdd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:07.245558 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd82ac-8e45-4f01-9e31-59c4d04bcdd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:07.247163 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd82ac-8e45-4f01-9e31-59c4d04bcdd1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:07.256549 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1430/2855] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:07.261278 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af62f2-6b52-45dd-a07d-2905dae25433 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:07.271540 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af62f2-6b52-45dd-a07d-2905dae25433 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:07.276771 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3ed6c-6090-4a2e-b036-414827a259ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:07.277409 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3ed6c-6090-4a2e-b036-414827a259ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:07.277689 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3ed6c-6090-4a2e-b036-414827a259ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:07.278003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3ed6c-6090-4a2e-b036-414827a259ea admin admin] PATH_INFO: `/v3/projects/7998cb728b7d419791a59902c36aac08/users/96ca48ad9e454c4ab94d79b0b4a948cf/roles/cac8d7ae8325488684667d62304b0860` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:07.279908 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3ed6c-6090-4a2e-b036-414827a259ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7998cb728b7d419791a59902c36aac08, user_id=96ca48ad9e454c4ab94d79b0b4a948cf, role_id=cac8d7ae8325488684667d62304b0860)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:07.282588 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3ed6c-6090-4a2e-b036-414827a259ea admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:07.292629 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1426/2856] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:50:07 2022] PUT /identity/v3/projects/7998cb728b7d419791a59902c36aac08/users/96ca48ad9e454c4ab94d79b0b4a948cf/roles/cac8d7ae8325488684667d62304b0860 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:50:07.924939 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28192e0b-860b-46f4-b14a-b82543053f02 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:07.925228 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28192e0b-860b-46f4-b14a-b82543053f02 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:07.925501 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28192e0b-860b-46f4-b14a-b82543053f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:07.955581 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-28192e0b-860b-46f4-b14a-b82543053f02 None None] MFA Rules not processed for user `96ca48ad9e454c4ab94d79b0b4a948cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:07.957267 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28192e0b-860b-46f4-b14a-b82543053f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:08.034377 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1431/2857] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:08.045381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bbaf7-5ff0-4420-8493-5c732845ff0c None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:08.045939 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bbaf7-5ff0-4420-8493-5c732845ff0c None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:08.046069 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bbaf7-5ff0-4420-8493-5c732845ff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:08.067719 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-d67bbaf7-5ff0-4420-8493-5c732845ff0c None None] MFA Rules not processed for user `f0658e406bb546e3b8c10a23c74bd33d`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:08.068946 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d67bbaf7-5ff0-4420-8493-5c732845ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:08.103122 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:08.131425 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1427/2858] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:08.144026 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28192e0b-860b-46f4-b14a-b82543053f02 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:08.145298 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28192e0b-860b-46f4-b14a-b82543053f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:08.225087 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28192e0b-860b-46f4-b14a-b82543053f02 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:08.230814 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:08.231421 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:08.231707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:08.231984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:08.239513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:08.241154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:08.246511 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:08.252944 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1432/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:08.283718 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bbaf7-5ff0-4420-8493-5c732845ff0c None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:08.285218 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-d67bbaf7-5ff0-4420-8493-5c732845ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:08.348857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bbaf7-5ff0-4420-8493-5c732845ff0c None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:08.352444 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0c16885de9e4e82bcbede361e548ec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:08.353050 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:08.354136 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:08.354419 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:08.356213 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:08.370053 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:08.371490 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:08.382388 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1428/2860] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:08.910247 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:08.911658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:08.972220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b1a29-faa4-4a20-a8fe-48c47ca65be5 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:08.975895 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:08.976435 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:08.976718 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:08.977045 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:08.978949 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:08.993219 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:08.995680 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:09.006835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1433/2861] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:18.377398 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=35 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:19.001821 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=26 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:20.167003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:20.168494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:20.224088 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86892015-9db1-444a-a5cc-9a89378d1154 service glance] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:20.227639 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67346fda-6f57-4b28-8d1c-8d977ccf3ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:20.228236 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67346fda-6f57-4b28-8d1c-8d977ccf3ebb service cinder] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:20.228515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67346fda-6f57-4b28-8d1c-8d977ccf3ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:20.228820 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67346fda-6f57-4b28-8d1c-8d977ccf3ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:20.237477 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67346fda-6f57-4b28-8d1c-8d977ccf3ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:20.238938 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67346fda-6f57-4b28-8d1c-8d977ccf3ebb service cinder] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:20.248891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1429/2862] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:30.244405 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=26 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:39.310835 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:39.312256 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:39.391964 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1b0bb-703b-4046-8aa3-0555cce89532 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:39.393631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:39.394651 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:39.394941 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:39.395220 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:39.397637 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:39.410485 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:39.412080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:39.423301 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1434/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:39.880640 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67346fda-6f57-4b28-8d1c-8d977ccf3ebb service cinder] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:39.944754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67346fda-6f57-4b28-8d1c-8d977ccf3ebb service cinder] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:39.950010 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:39.950632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:39.950911 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:39.951220 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] PATH_INFO: `/v3/users/f0658e406bb546e3b8c10a23c74bd33d` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:39.952332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0658e406bb546e3b8c10a23c74bd33d)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:39.954294 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:40.001464 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0658e406bb546e3b8c10a23c74bd33d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.002138 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0658e406bb546e3b8c10a23c74bd33d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.015018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0658e406bb546e3b8c10a23c74bd33d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.022223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0658e406bb546e3b8c10a23c74bd33d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.022865 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0658e406bb546e3b8c10a23c74bd33d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.034927 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1430/2864] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:50:39 2022] DELETE /identity/v3/users/f0658e406bb546e3b8c10a23c74bd33d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:40.211513 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:40.227426 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb48-bc84-4820-825d-425748f17f6a service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:40.285612 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:40.286258 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:40.286536 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:40.286807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] PATH_INFO: `/v3/projects/fbd24cd4d3074fd38c6d24b58c8850ab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:40.287901 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd24cd4d3074fd38c6d24b58c8850ab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:40.289781 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:40.337403 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd24cd4d3074fd38c6d24b58c8850ab', 'request_id': 'req-389595da-f979-4e95-9b05-956bd7ddcd42'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.346080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd24cd4d3074fd38c6d24b58c8850ab', 'request_id': 'req-389595da-f979-4e95-9b05-956bd7ddcd42'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.351521 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd24cd4d3074fd38c6d24b58c8850ab', 'request_id': 'req-389595da-f979-4e95-9b05-956bd7ddcd42'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.363805 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] The token cache is being invalidate because project fbd24cd4d3074fd38c6d24b58c8850ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:50:40.364094 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.364729 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.366234 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1435/2865] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:50:40 2022] DELETE /identity/v3/projects/fbd24cd4d3074fd38c6d24b58c8850ab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:40.371083 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:40.372521 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:40.385341 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce28d-59a2-4ef9-9b96-228bc72b2e83 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:40.441244 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:40.441903 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:40.442188 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:40.442457 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] PATH_INFO: `/v3/users/96ca48ad9e454c4ab94d79b0b4a948cf` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:40.443568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ca48ad9e454c4ab94d79b0b4a948cf)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:40.445476 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:40.467446 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:40.492792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ca48ad9e454c4ab94d79b0b4a948cf'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.493433 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ca48ad9e454c4ab94d79b0b4a948cf'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.505153 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ca48ad9e454c4ab94d79b0b4a948cf'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.512679 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ca48ad9e454c4ab94d79b0b4a948cf'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.513283 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-7fba7e42-c49b-4448-b741-9ac8749ff0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ca48ad9e454c4ab94d79b0b4a948cf'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.525232 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1431/2866] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:50:40 2022] DELETE /identity/v3/users/96ca48ad9e454c4ab94d79b0b4a948cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:40.698048 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:40.699498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:40.712599 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389595da-f979-4e95-9b05-956bd7ddcd42 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:40.730468 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:40.773786 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:40.774428 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:40.774704 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:40.774971 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] PATH_INFO: `/v3/projects/7998cb728b7d419791a59902c36aac08` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:40.776075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7998cb728b7d419791a59902c36aac08)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:40.779067 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:40.823312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7998cb728b7d419791a59902c36aac08', 'request_id': 'req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.831196 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7998cb728b7d419791a59902c36aac08', 'request_id': 'req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.836707 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7998cb728b7d419791a59902c36aac08', 'request_id': 'req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.848169 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] The token cache is being invalidate because project 7998cb728b7d419791a59902c36aac08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:50:40.848449 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.849077 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a0c3cb7e-9849-47f1-8dfc-2d522dac3186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:40.850564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1436/2867] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:50:40 2022] DELETE /identity/v3/projects/7998cb728b7d419791a59902c36aac08 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:40.855852 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71e94-79d4-4ad6-885f-cb07753255da None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:40.856140 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71e94-79d4-4ad6-885f-cb07753255da None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:40.856414 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71e94-79d4-4ad6-885f-cb07753255da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:40.875859 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-e3f71e94-79d4-4ad6-885f-cb07753255da None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:40.877074 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-e3f71e94-79d4-4ad6-885f-cb07753255da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:40.935579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1432/2868] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:50:40.943230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb9824-7d2f-4c87-993c-cd0dbda6e3a5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:40.943518 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb9824-7d2f-4c87-993c-cd0dbda6e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:40.943794 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb9824-7d2f-4c87-993c-cd0dbda6e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:40.963622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a3fb9824-7d2f-4c87-993c-cd0dbda6e3a5 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:40.965684 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3fb9824-7d2f-4c87-993c-cd0dbda6e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:40.973631 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1437/2869] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:40.977793 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71e94-79d4-4ad6-885f-cb07753255da None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:40.987873 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71e94-79d4-4ad6-885f-cb07753255da None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:40.992708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:40.993295 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:40.993569 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:40.993857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:40.994499 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:50:40.994796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:40.996691 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:41.007906 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1433/2870] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:50:41.013034 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb9824-7d2f-4c87-993c-cd0dbda6e3a5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:41.022332 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb9824-7d2f-4c87-993c-cd0dbda6e3a5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:41.027643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0653-d9c1-4e39-ba8b-331b77df795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:41.028230 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0653-d9c1-4e39-ba8b-331b77df795e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:41.028509 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0653-d9c1-4e39-ba8b-331b77df795e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:41.028777 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0653-d9c1-4e39-ba8b-331b77df795e admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:41.029399 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd0653-d9c1-4e39-ba8b-331b77df795e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:41.031321 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd0653-d9c1-4e39-ba8b-331b77df795e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:41.058622 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1438/2871] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:50:41 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:50:41.062751 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:41.072818 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f93a9-90f9-48d9-8bb0-ce4125d246b1 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:41.128449 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fb740-853f-4b4b-8445-e8666362b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:41.129254 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb740-853f-4b4b-8445-e8666362b6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:41.129366 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb740-853f-4b4b-8445-e8666362b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:41.129584 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb740-853f-4b4b-8445-e8666362b6a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:41.130253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fb740-853f-4b4b-8445-e8666362b6a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:41.132223 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fb740-853f-4b4b-8445-e8666362b6a9 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:41.153732 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1434/2872] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:50:41 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:41.157861 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0653-d9c1-4e39-ba8b-331b77df795e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:41.168124 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0653-d9c1-4e39-ba8b-331b77df795e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:41.172663 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096723c-1403-4077-95f5-a49dfbb71ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:41.173248 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096723c-1403-4077-95f5-a49dfbb71ced admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:41.173527 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096723c-1403-4077-95f5-a49dfbb71ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:41.173802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096723c-1403-4077-95f5-a49dfbb71ced admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:41.174464 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096723c-1403-4077-95f5-a49dfbb71ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:41.176152 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096723c-1403-4077-95f5-a49dfbb71ced admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:41.186531 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1439/2873] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:41.190467 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fb740-853f-4b4b-8445-e8666362b6a9 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:41.201373 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fb740-853f-4b4b-8445-e8666362b6a9 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:41.205992 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0c410-7ad9-4aad-8b8d-0c7033668586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:41.206579 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c410-7ad9-4aad-8b8d-0c7033668586 admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:41.206857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c410-7ad9-4aad-8b8d-0c7033668586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:41.207129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0c410-7ad9-4aad-8b8d-0c7033668586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:41.207758 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c410-7ad9-4aad-8b8d-0c7033668586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:41.209381 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0c410-7ad9-4aad-8b8d-0c7033668586 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:41.220052 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1435/2874] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:41.224127 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096723c-1403-4077-95f5-a49dfbb71ced admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:41.234070 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096723c-1403-4077-95f5-a49dfbb71ced admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:41.238682 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:41.239318 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:41.239602 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:41.239878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] PATH_INFO: `/v3/projects/d30d9f6a941c405a99265bc3628f07c8/users/2752f2fb126a4e4e87efe80d673b430d/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:41.255312 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30d9f6a941c405a99265bc3628f07c8, user_id=2752f2fb126a4e4e87efe80d673b430d, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:41.257984 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:41.271706 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1440/2875] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:50:41 2022] PUT /identity/v3/projects/d30d9f6a941c405a99265bc3628f07c8/users/2752f2fb126a4e4e87efe80d673b430d/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:41.282163 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1b93d-af32-4189-bc37-913a44f8090b None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:41.282452 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1b93d-af32-4189-bc37-913a44f8090b None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:41.282724 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1b93d-af32-4189-bc37-913a44f8090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:41.290853 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:41.311428 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-01b1b93d-af32-4189-bc37-913a44f8090b None None] MFA Rules not processed for user `2752f2fb126a4e4e87efe80d673b430d`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:41.312638 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-01b1b93d-af32-4189-bc37-913a44f8090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:41.384482 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1436/2876] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:41.395475 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:41.397351 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:41.452498 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:41.458767 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb471-c5b4-4add-ab66-c00963b45341 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:41.463299 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189755e4-7fd9-4935-82f4-b43010f71b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:41.464690 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189755e4-7fd9-4935-82f4-b43010f71b2a service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:41.464989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189755e4-7fd9-4935-82f4-b43010f71b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:41.465431 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189755e4-7fd9-4935-82f4-b43010f71b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:41.473828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189755e4-7fd9-4935-82f4-b43010f71b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:41.475333 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189755e4-7fd9-4935-82f4-b43010f71b2a service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:41.484802 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1441/2877] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:46.812954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1b93d-af32-4189-bc37-913a44f8090b None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:46.876150 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1b93d-af32-4189-bc37-913a44f8090b None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:46.880690 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:46.881351 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:46.881632 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:46.881934 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] PATH_INFO: `/v3/users/2752f2fb126a4e4e87efe80d673b430d` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:46.883124 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2752f2fb126a4e4e87efe80d673b430d)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:46.885057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:46.931709 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2752f2fb126a4e4e87efe80d673b430d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:46.932364 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2752f2fb126a4e4e87efe80d673b430d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:46.944922 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2752f2fb126a4e4e87efe80d673b430d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:46.952093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2752f2fb126a4e4e87efe80d673b430d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:46.952705 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2752f2fb126a4e4e87efe80d673b430d'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:46.964795 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1437/2878] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:50:46 2022] DELETE /identity/v3/users/2752f2fb126a4e4e87efe80d673b430d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:46.969427 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c5c7-d1c9-4bcc-9663-3cddd67a1f48 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:46.969935 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c5c7-d1c9-4bcc-9663-3cddd67a1f48 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:46.970114 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c5c7-d1c9-4bcc-9663-3cddd67a1f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:46.988989 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1446c5c7-d1c9-4bcc-9663-3cddd67a1f48 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:46.990300 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1446c5c7-d1c9-4bcc-9663-3cddd67a1f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:47.048564 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1442/2879] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:47.058119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:47.060194 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:47.074098 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:47.118609 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70734ba6-b6dc-4e41-b9fb-521f76c88717 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:47.122352 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e79e-6641-4198-bfc7-61399e65a05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:47.122954 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e79e-6641-4198-bfc7-61399e65a05c service neutron] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.123233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e79e-6641-4198-bfc7-61399e65a05c service neutron] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.123506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e79e-6641-4198-bfc7-61399e65a05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.132628 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70e79e-6641-4198-bfc7-61399e65a05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:47.134105 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70e79e-6641-4198-bfc7-61399e65a05c service neutron] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:47.143937 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1438/2880] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:47.409460 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446c5c7-d1c9-4bcc-9663-3cddd67a1f48 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:47.410926 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1446c5c7-d1c9-4bcc-9663-3cddd67a1f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:47.427162 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446c5c7-d1c9-4bcc-9663-3cddd67a1f48 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:47.432373 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:47.433004 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.442001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.442314 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] PATH_INFO: `/v3/projects/d30d9f6a941c405a99265bc3628f07c8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.443523 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30d9f6a941c405a99265bc3628f07c8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:47.445463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:47.499161 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30d9f6a941c405a99265bc3628f07c8', 'request_id': 'req-6b74f66d-e74b-418c-8088-4e7180632ec1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:47.506469 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30d9f6a941c405a99265bc3628f07c8', 'request_id': 'req-6b74f66d-e74b-418c-8088-4e7180632ec1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:47.512542 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30d9f6a941c405a99265bc3628f07c8', 'request_id': 'req-6b74f66d-e74b-418c-8088-4e7180632ec1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:47.523286 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] The token cache is being invalidate because project d30d9f6a941c405a99265bc3628f07c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:50:47.523572 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:47.524200 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b74f66d-e74b-418c-8088-4e7180632ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:50:47.525674 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1443/2881] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:50:47 2022] DELETE /identity/v3/projects/d30d9f6a941c405a99265bc3628f07c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:47.531972 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7c7b-c715-425c-82a2-022cbeff7048 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.532332 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7c7b-c715-425c-82a2-022cbeff7048 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.532674 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb7c7b-c715-425c-82a2-022cbeff7048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.551654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-babb7c7b-c715-425c-82a2-022cbeff7048 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:47.552841 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-babb7c7b-c715-425c-82a2-022cbeff7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:47.615520 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1439/2882] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:47.623361 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b034745-c460-4fe4-b40c-31c46c293e16 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.623647 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b034745-c460-4fe4-b40c-31c46c293e16 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.623925 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b034745-c460-4fe4-b40c-31c46c293e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.644451 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7b034745-c460-4fe4-b40c-31c46c293e16 None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:47.645830 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b034745-c460-4fe4-b40c-31c46c293e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:47.654611 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1444/2883] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:47.658857 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb7c7b-c715-425c-82a2-022cbeff7048 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:47.668505 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb7c7b-c715-425c-82a2-022cbeff7048 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:47.673118 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:47.673708 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.674090 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.674365 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] PATH_INFO: `/v3/domains` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.675003 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:50:47.675301 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:47.676895 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:47.688436 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1440/2884] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 15:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:50:47.692806 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b034745-c460-4fe4-b40c-31c46c293e16 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:47.702594 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b034745-c460-4fe4-b40c-31c46c293e16 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:47.707208 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca263c-b466-4493-8671-b3e71023540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:47.707800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca263c-b466-4493-8671-b3e71023540b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.708080 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca263c-b466-4493-8671-b3e71023540b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.708355 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca263c-b466-4493-8671-b3e71023540b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.708985 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca263c-b466-4493-8671-b3e71023540b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:47.710920 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca263c-b466-4493-8671-b3e71023540b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:47.738547 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1445/2885] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 15:50:47 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:47.742965 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:47.752797 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ee282-df71-41fd-9c75-414ff759f38a admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:47.808500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1329-407e-48a6-8d8f-432113a9a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:47.809097 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1329-407e-48a6-8d8f-432113a9a279 admin admin] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.809380 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1329-407e-48a6-8d8f-432113a9a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.809654 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1329-407e-48a6-8d8f-432113a9a279 admin admin] PATH_INFO: `/v3/users` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.810289 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e1329-407e-48a6-8d8f-432113a9a279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:47.812222 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e1329-407e-48a6-8d8f-432113a9a279 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:47.832633 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1441/2886] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 15:50:47 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:50:47.836743 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca263c-b466-4493-8671-b3e71023540b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:47.847574 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca263c-b466-4493-8671-b3e71023540b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:47.852352 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f0a7f-885f-4bd0-bef2-8e3b12d29088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:47.852955 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f0a7f-885f-4bd0-bef2-8e3b12d29088 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.853238 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f0a7f-885f-4bd0-bef2-8e3b12d29088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.853515 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f0a7f-885f-4bd0-bef2-8e3b12d29088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.854194 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f0a7f-885f-4bd0-bef2-8e3b12d29088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:47.855828 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f0a7f-885f-4bd0-bef2-8e3b12d29088 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:47.865800 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1446/2887] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:47.869829 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1329-407e-48a6-8d8f-432113a9a279 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:47.880274 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1329-407e-48a6-8d8f-432113a9a279 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:47.884888 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb424a-8f65-4f74-8f1c-3ffa4347789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:47.885474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb424a-8f65-4f74-8f1c-3ffa4347789f admin admin] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.885754 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb424a-8f65-4f74-8f1c-3ffa4347789f admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.886057 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb424a-8f65-4f74-8f1c-3ffa4347789f admin admin] PATH_INFO: `/v3/roles` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.886695 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb424a-8f65-4f74-8f1c-3ffa4347789f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:47.889192 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb424a-8f65-4f74-8f1c-3ffa4347789f admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:47.899999 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1442/2888] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 15:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:50:47.904389 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f0a7f-885f-4bd0-bef2-8e3b12d29088 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:47.914367 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f0a7f-885f-4bd0-bef2-8e3b12d29088 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:47.918958 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:47.919596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.919878 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.920153 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] PATH_INFO: `/v3/projects/7ebce5d2f5574ce69c6347fd335a7217/users/e1dad59ffcb34a9686c19cdd4800c09e/roles/a92b62fe43214de0b1468165da0d5456` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.935413 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebce5d2f5574ce69c6347fd335a7217, user_id=e1dad59ffcb34a9686c19cdd4800c09e, role_id=a92b62fe43214de0b1468165da0d5456)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:47.938720 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:47.951992 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1447/2889] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 15:50:47 2022] PUT /identity/v3/projects/7ebce5d2f5574ce69c6347fd335a7217/users/e1dad59ffcb34a9686c19cdd4800c09e/roles/a92b62fe43214de0b1468165da0d5456 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:50:47.957165 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb7c0b-5592-4e13-bfa5-72e74e8915da None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:47.957455 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb7c0b-5592-4e13-bfa5-72e74e8915da None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:47.957731 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb7c0b-5592-4e13-bfa5-72e74e8915da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:47.976767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-3fcb7c0b-5592-4e13-bfa5-72e74e8915da None None] MFA Rules not processed for user `12ecd30dbfea46b7b32ac0a7df499823`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:47.978036 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-3fcb7c0b-5592-4e13-bfa5-72e74e8915da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:47.994500 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:48.038129 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1443/2890] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:48.047807 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:48.049483 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:48.060694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:48.107409 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f4779-4034-41ec-be03-67b24f591fae admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:48.111016 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:48.111607 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:48.111884 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:48.112154 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:48.121141 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:48.123133 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:48.132711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1448/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:48.749891 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb2fa4-2a7e-4ccc-ab43-532a50fc2ff8 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:48.750210 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb2fa4-2a7e-4ccc-ab43-532a50fc2ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:48.750491 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb2fa4-2a7e-4ccc-ab43-532a50fc2ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:48.787110 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-06cb2fa4-2a7e-4ccc-ab43-532a50fc2ff8 None None] MFA Rules not processed for user `e1dad59ffcb34a9686c19cdd4800c09e`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:48.788325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-06cb2fa4-2a7e-4ccc-ab43-532a50fc2ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:48.855349 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1444/2892] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:48.866792 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:48.868284 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:48.925650 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff903bf-b703-4fe6-8da7-68fe4a893dae service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:48.930207 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3adaa1462c8a4acdab7e631a795cd40f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:48.930823 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:48.931106 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:48.931408 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:48.940204 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:48.941562 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:48.950694 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1449/2893] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:50.308767 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc645577-0286-4674-a9d2-40514d519cc1 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:50.309310 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc645577-0286-4674-a9d2-40514d519cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:50.309412 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc645577-0286-4674-a9d2-40514d519cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:50.327926 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-fc645577-0286-4674-a9d2-40514d519cc1 None None] MFA Rules not processed for user `e1dad59ffcb34a9686c19cdd4800c09e`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:50:50.329119 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fc645577-0286-4674-a9d2-40514d519cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:50.335971 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1445/2894] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:50:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:50:50.577079 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:50.578506 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:50.591001 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf907c4-4189-461c-8620-e689715d6e7b service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:50.594591 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:50.595183 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:50.595462 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:50.595735 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:50.597393 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:50.606892 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:50.608310 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:50.616456 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1450/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:50:50.939666 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc645577-0286-4674-a9d2-40514d519cc1 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:50.941120 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-fc645577-0286-4674-a9d2-40514d519cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:51.016474 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc645577-0286-4674-a9d2-40514d519cc1 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:51.021329 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:51.021956 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:51.022233 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:51.022503 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:51.024221 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:51.036012 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:51.037568 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:51.047791 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1446/2896] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:53.141418 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:53.150400 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f73c2-e380-4eb6-99e8-7973f613fa05 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:53.154859 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8a5a-7c35-438d-982a-3dc732f2419d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9962d812513a428b99ada1f79a5b88d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:53.155467 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8a5a-7c35-438d-982a-3dc732f2419d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:53.155749 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8a5a-7c35-438d-982a-3dc732f2419d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:53.156023 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8a5a-7c35-438d-982a-3dc732f2419d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:53.157809 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2eeb8a5a-7c35-438d-982a-3dc732f2419d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:53.167906 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8a5a-7c35-438d-982a-3dc732f2419d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:53.170251 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8a5a-7c35-438d-982a-3dc732f2419d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:53.179081 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1451/2897] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:50:58.250061 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:50:58.251822 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:58.293141 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=100 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:50:58.327423 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dbbdd-ae5d-48db-ab87-cfff544da95e service placement] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:50:58.332899 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce870c-ccdd-437e-ae0a-82fae383714e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38af4d5f21ae43b699d7890ce9534d29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:50:58.333506 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce870c-ccdd-437e-ae0a-82fae383714e service nova] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:50:58.333790 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce870c-ccdd-437e-ae0a-82fae383714e service nova] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:50:58.334093 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce870c-ccdd-437e-ae0a-82fae383714e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:50:58.335827 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-94ce870c-ccdd-437e-ae0a-82fae383714e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:50:58.348641 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce870c-ccdd-437e-ae0a-82fae383714e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:50:58.350256 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce870c-ccdd-437e-ae0a-82fae383714e service nova] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:50:58.361277 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1447/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:50:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:51:03.175075 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=60 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:04.411331 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ea32-3a13-43bf-a1fa-962532dd379d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:51:04.411933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ea32-3a13-43bf-a1fa-962532dd379d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:51:04.411933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ea32-3a13-43bf-a1fa-962532dd379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:51:04.431118 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6640ea32-3a13-43bf-a1fa-962532dd379d None None] MFA Rules not processed for user `e1dad59ffcb34a9686c19cdd4800c09e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:51:04.432315 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6640ea32-3a13-43bf-a1fa-962532dd379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:51:04.440643 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1452/2899] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 15:51:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:51:08.356253 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=18 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:14.425223 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:20.230399 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bea964-ec19-4810-a8fd-8d7bfc8b6e40 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:51:20.230969 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bea964-ec19-4810-a8fd-8d7bfc8b6e40 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:51:20.231439 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bea964-ec19-4810-a8fd-8d7bfc8b6e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:51:20.293076 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-21bea964-ec19-4810-a8fd-8d7bfc8b6e40 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:51:20.294325 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-21bea964-ec19-4810-a8fd-8d7bfc8b6e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:51:20.359637 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1448/2900] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 15:51:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:51:20.408177 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640ea32-3a13-43bf-a1fa-962532dd379d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:51:20.409606 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6640ea32-3a13-43bf-a1fa-962532dd379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:51:20.502463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640ea32-3a13-43bf-a1fa-962532dd379d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:51:20.507596 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c712-ecf8-47c8-928c-eb4f4286653e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:51:20.508214 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c712-ecf8-47c8-928c-eb4f4286653e service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:51:20.508492 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c712-ecf8-47c8-928c-eb4f4286653e service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:51:20.508765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c712-ecf8-47c8-928c-eb4f4286653e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:51:20.517683 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c712-ecf8-47c8-928c-eb4f4286653e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:51:20.519289 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c712-ecf8-47c8-928c-eb4f4286653e service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:51:20.529711 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1453/2901] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:51:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:51:30.356796 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=44 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:30.525353 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=41 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:34.934940 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7112-ecc0-4e97-952e-5d029eae6dd6 None None] REQUEST_METHOD: `POST` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:51:34.935417 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7112-ecc0-4e97-952e-5d029eae6dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:51:34.935515 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7112-ecc0-4e97-952e-5d029eae6dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:51:34.955494 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.auth.core [None req-41ae7112-ecc0-4e97-952e-5d029eae6dd6 None None] MFA Rules not processed for user `4be8758e659641e6bf49f7cc60b5e2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:51:34.956696 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-41ae7112-ecc0-4e97-952e-5d029eae6dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:51:34.963792 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1449/2902] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 26 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:51:34.976180 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c712-ecf8-47c8-928c-eb4f4286653e service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:51:34.987868 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c712-ecf8-47c8-928c-eb4f4286653e service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:51:34.993754 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57462-c209-4ef8-a3c3-9789bffee70a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a184d53f1e4ebaaf55beee0f889bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:51:34.994380 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57462-c209-4ef8-a3c3-9789bffee70a service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:51:34.994658 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57462-c209-4ef8-a3c3-9789bffee70a service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:51:34.994947 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d57462-c209-4ef8-a3c3-9789bffee70a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:51:35.004296 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d57462-c209-4ef8-a3c3-9789bffee70a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:51:35.005900 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d57462-c209-4ef8-a3c3-9789bffee70a service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:51:35.013765 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1454/2903] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 26 15:51:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:51:36.916916 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae7112-ecc0-4e97-952e-5d029eae6dd6 None None] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:51:36.931174 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae7112-ecc0-4e97-952e-5d029eae6dd6 None None] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:51:36.935773 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:51:36.936401 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:51:36.936684 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:51:36.936960 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] PATH_INFO: `/v3/users/e1dad59ffcb34a9686c19cdd4800c09e` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:51:36.938836 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dad59ffcb34a9686c19cdd4800c09e)` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:51:36.940809 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:51:36.991385 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dad59ffcb34a9686c19cdd4800c09e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:36.991945 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dad59ffcb34a9686c19cdd4800c09e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.004018 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dad59ffcb34a9686c19cdd4800c09e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.011286 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dad59ffcb34a9686c19cdd4800c09e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.011907 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.notifications [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dad59ffcb34a9686c19cdd4800c09e'} {{(pid=81828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.024844 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1450/2904] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 15:51:36 2022] DELETE /identity/v3/users/e1dad59ffcb34a9686c19cdd4800c09e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:51:37.210494 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57462-c209-4ef8-a3c3-9789bffee70a service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:51:37.221879 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d57462-c209-4ef8-a3c3-9789bffee70a service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:51:37.278819 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecd30dbfea46b7b32ac0a7df499823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63b0c3551a8436a97c9341435afc499', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:51:37.279370 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:51:37.279655 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:51:37.279933 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] PATH_INFO: `/v3/projects/7ebce5d2f5574ce69c6347fd335a7217` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:51:37.281157 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebce5d2f5574ce69c6347fd335a7217)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:51:37.283111 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:51:37.329190 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebce5d2f5574ce69c6347fd335a7217', 'request_id': 'req-4b8a69fb-9f69-4868-b103-be328f41d629'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.336463 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebce5d2f5574ce69c6347fd335a7217', 'request_id': 'req-4b8a69fb-9f69-4868-b103-be328f41d629'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.341912 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebce5d2f5574ce69c6347fd335a7217', 'request_id': 'req-4b8a69fb-9f69-4868-b103-be328f41d629'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.353545 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] The token cache is being invalidate because project 7ebce5d2f5574ce69c6347fd335a7217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:51:37.353825 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.354472 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b8a69fb-9f69-4868-b103-be328f41d629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:51:37.356198 dv-cinder-851449-7-smb devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1455/2905] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 15:51:37 2022] DELETE /identity/v3/projects/7ebce5d2f5574ce69c6347fd335a7217 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:51:47.021323 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:51:47.350678 dv-cinder-851449-7-smb devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:53:12.201578 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] Authenticating user token {{(pid=81828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:53:12.203030 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:53:12.273550 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772becd-34b3-4ff2-9267-bc33f4bc11d4 admin admin] Validating token access rules against request {{(pid=81828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:53:12.332249 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c5a4-95a6-44e2-af1b-1b6437080598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5246da8ac5b943d58b1d565cc4658491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869b42f452de4211a9430e6cf453f862', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:53:12.332966 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c5a4-95a6-44e2-af1b-1b6437080598 service placement] REQUEST_METHOD: `GET` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:53:12.333252 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c5a4-95a6-44e2-af1b-1b6437080598 service placement] SCRIPT_NAME: `/identity` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:53:12.333529 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c5a4-95a6-44e2-af1b-1b6437080598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:53:12.335344 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.fernet_utils [None req-ef51c5a4-95a6-44e2-af1b-1b6437080598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:53:12.347692 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51c5a4-95a6-44e2-af1b-1b6437080598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:53:12.349324 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51c5a4-95a6-44e2-af1b-1b6437080598 service placement] RBAC: Authorization granted {{(pid=81828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:53:12.359371 dv-cinder-851449-7-smb devstack@keystone.service[81828]: [pid: 81828|app: 0|req: 1451/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 15:53:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:53:22.354964 dv-cinder-851449-7-smb devstack@keystone.service[81828]: DEBUG dbcounter [-] [81828] Writing DB stats keystone:SELECT=58 {{(pid=81828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}